Immersive sound effects, VR 3D painting

　　What "black technologies" were presented in the Spring Festival Gala of the Year of the Rabbit?

　　At 8 pm on January 21, 2023, the Spring Festival Gala for the Year of the Rabbit kicked off as scheduled. During the four and a half hours of performance, the audience could not only enjoy traditional programs such as acrobatic dances, chorus songs, cross talk sketches, etc. The gorgeous scenes and moving sound effects presented are full of technological elements, and some creative new programs full of technological sense are also eye-catching.

Three-dimensional colorful sound:

　　Let the audience "sound" immersive

　　This year's Spring Festival Gala, China Central Radio and Television made another breakthrough in technological innovation and application, achieving multiple "firsts", one of which was the first use of three-dimensional jingle sound to produce the audio signal of the Spring Festival Gala, restoring the sound effect of the Spring Festival Gala to the maximum extent.

　　This technology can build a well-defined, clear and uniform sound field, bringing a more live listening experience to the audience in front of the TV, and making the sound at the party more real and vivid.

　　What is the three-dimensional color sound?

How is it different from traditional sound?

And on what basis?

　　According to public information, 3D sound increases the sense of space and orientation compared with traditional sound, and can reproduce the sound heard in the real world, so as to meet people's needs for a highly restored and immersive experience of sound. At the same time, it can have personalized options and Interactive experience.

Attentive audiences may have noticed that the three-dimensional brilliant sound in this Spring Festival Gala has personalized selection and interactive experience, and audiences can customize the sound quality more suitable for them according to their needs.

　　The generation of 3D colorful sound will go through multiple steps, among which codec and rendering are very important.

Especially for encoding and decoding, different technical tools are used to encode and decode input signals for different signal types, for example, multi-channel coding technology is used to remove information redundancy between multi-channel signals.

These technical tools can solve many "information redundancy" problems, and provide guarantee for the final rendering of "sound" immersive experience.

　　It is worth mentioning that the three-dimensional Jingcai sound is a three-dimensional sound technology independently developed by my country.

According to relevant reports, before its launch, my country had relatively little technology accumulation, and the international mainstream 3D sound technology solutions have long been formulated by foreign companies or standards organizations.

Today, the launch and application of 3D Jingcai Sound has enabled my country to get rid of the "stuck neck" problem of the key technology of ultra-high-definition audio and video.

　VR 3D image rendering technology:

　　Instant Creation on the Spring Festival Gala Stage

　　The Spring Festival Gala of the Year of the Rabbit not only has new applications in sound, but also bursts out new ideas in visual presentation.

Among them, although the VR artist's on-site painting is only "a glimpse", it is enough to leave a deep impression on people.

　　At the beginning of the creative program "When the "God Beast" Meets the God Beast", the artist wears VR glasses and holds a VR handle, "out of thin air" adds feathers to the phoenix and adds eyes to the unicorn, allowing the audience to appreciate the generation process of the 3D image in real time and feel the beauty of VR painting. charm.

　　According to related reports, this is the VR three-dimensional image rendering technology led by China Central Radio and Television, which made its debut on the stage of this year's Spring Festival Gala.

The VR painter on the stage can select the color and brushwork through the buttons on the VR handle, and at the same time view the drawn 3D image effect in real time through the VR glasses, and the drawn 3D image will be processed by the rendering and synthesis server, and then superimposed on the big TV screen in real time for a wonderful presentation , so that the audience can simultaneously watch three-dimensional images of phoenixes and unicorns in the virtual space.

　　With the popularity of VR technology in recent years, more and more artists have begun to try to use this new tool to create novel and interesting 3D works.

Compared with traditional 3D modeling tools, painting with VR tools is more like shaping sculptures. It allows creators to draw in various directions such as front, back, left, and right in the virtual space, and even enter the interior of the work to adjust and modify, creating a An experience of "people swimming in the painting".

(West China Metropolis Daily - cover news reporter Tan Yuqing)

　　(Source: West China Metropolis Daily, January 28, 2023, page A12)