IAMF uses artificial intelligence and deep learning technology to analyze scenes and emphasize certain aspects of the content by adjusting audio levels to enhance sound throughout the viewing experience.
Samsung Research
Samsung's sound lab developed 3D audio that adds a deeper level of immersion to entertainment experiences, bringing thrilling action scenes to life and capturing the quietest details of ambient noise.
3D audio on Samsung Smart TVs allows users to feel as if they are actually in the middle of the action. Traditionally, installed in movie theaters or recording studios, 3D audio has arrived in homes to provide a new way to enjoy your favorite content.
In turn, Samsung has worked with companies such as Google with whom they developed Immersive Audio Model and Formats (IAMF), an advanced 3D spatial audio technology that was adopted by the Alliance for Open Media (AOM) in October 2023.
A new way to enjoy 3D audio at home
Ambient noise exists in every scene, from the sound of shoes scraping the sidewalk, to the noise of cars driving by. While this noise may seem unnecessary, it is vital to add depth and a sense of reality. 3D audio continuously combines ambient noise with conversations and other sound effects to create a more vibrant and authentic entertainment experience.
"3D audio makes you feel like you're really at the heart of the action by adjusting the strength, movement and vibration of the sound. This way, viewers can enjoy fuller-bodied sound that captures the 3D aspects of the world around us," said WooHyun Nam of Samsung Research's Visual Technology Team.
Samsung has worked hard with Google to develop an audio solution that allows viewers to experience the audio of the content as intended. "If device manufacturers can read 3D audio data, they can adjust the sound on audio devices, enabling immersive audio experiences with standard TV speakers or soundbars at home. By adjusting the audio to match the home device's environment, listeners can experience the audio as the creator intended," explains Nam.
A uniform standard is required to send and receive audio data seamlessly between device creators and manufacturers. "Samsung and Google's respective expertise in devices and content made the companies ideal partners to create IAMF technology. By coming together to develop this unprecedented technology, we are paving the way for users to enjoy 3D audio in their homes," said JeongHoon Park, Executive Vice President and Head of the Visual Technology Team at Samsung Research.
Ability to express sound vertically
Previous open-source audio codecs only supported horizontal sound expression. With IAMF technology, audio can now be expressed vertically to make it increasingly multidirectional. IAMF makes sound more realistic by allowing listeners to hear audio in front, behind, or on both sides and above or below them. When IAMF technology is applied to TV speakers and soundbars, it allows listeners to hear sounds like birds flying overhead on their TVs at home.
AI-based scene analysis and 3D audio effects
IAMF uses artificial intelligence and deep learning technology to analyze scenes and emphasize certain aspects of the content by adjusting audio levels to enhance sound throughout the viewing experience. In television and film, there are certain scenes where the soundtrack or background music is the main focus. FMI balances the sound in these cases. Similarly, the technology fine-tunes the audio when there is dialogue between characters to allow the listener to focus on the conversation.
In addition, IAMF technology provides optimal sound despite changes in the device environment. By adjusting the audio data of the scene analysis according to the device's environment, IAMF technology enables listeners to enjoy the original sound quality of the content.
Highly Personalized Audio
Users will be able to freely adjust the sound according to their preferences with IAMF technology. Whether you're looking to amplify the sound effects of an action scene or enhance dialogue.
