On June 10, 2021, HTC VIVE held a new product experience conference and developer Customer Conference in Beijing with the theme of “Convergence · To the World”. Nearly 300 XR industry elites gathered to witness the first public debut of HTC VIVE all-in-one VR VIVE FOCUS 3 and innovative professional PC-VR VIVE PRO 2. And bring a number of outstanding cutting-edge application cases, demonstrating the latest trends and outstanding achievements of XR industry technology. As one of the first companies to join HTC VIVE ISV Partner program, Agora was invited to attend the conference and had in-depth discussions on ISV partner program, VR/XR, real-time interaction and other topics.
HTC VIVE ISV Partner Panel
RTE+XR, innovation scene without boundaries
With the development of technology, VR/AR/MR and other XR technologies have been landed in many industries. Nearly two years, because of the outbreak, the whole house home office, study, entertainment has become a global trend, with online classes, video conference, remote medical treatment, remote interview, such as electricity live many real-time interactive, real-time interactive (RTE) has become the first need, also for the application of XR technology development provides the rich scene. Hou Yunyi, head of sonnet IoT products, pointed out that the combination of real-time interaction and XR is the trend of the industry and the best practice for building the recently popular Metaverse metauniverse. Both for individual users and enterprise users, the emphasis of XR scene is users realize the depth of immersion in a virtual world experience and real-time interconnection and interaction, and real time audio and video technology can break the boundary of virtual and reality, to the user in the virtual world of low delay, stable and smooth real-time interactive experience.
Hou Yunyi, head of Sonnet IoT products
Hou yunyi believes that working with HTC VIVE can bring richer, innovative and interesting scenarios to the practice of real-time interaction. But more important is the real-time audio and video technology that can help relevant XR developers seamlessly access the sound net, explore more innovations in scenarios and applications, and accelerate the implementation of relevant application scenarios. From a consumer perspective, RTE+XR can inspire developers to create richer content and create a more immersive experience for users. At the same time, Guangzhou Chuanghuan Digital Technology Co., LTD., which joined THE ISV partner program to provide virtual idol business services, is also a sNET customer. Through the real-time audio and video technology of sonnet, the imaginary two-dimensional virtual idol breaks the dimensional wall and interacts with users in real time, bringing users wonderful imagination space and unique experience between virtual and reality. From the perspective of enterprise market, RTE+XR can bring more efficient experience to remote collaboration scenarios such as remote survey, telemedicine and intelligent manufacturing, saving enterprises’ time cost and helping them realize digitalization and intelligence. Virbela, which builds immersive 3D worlds for remote work, online learning and virtual activities, is one of sonnet’s clients. In the virtual world constructed by Virbela, each user can create a unique virtual identity. Through the real-time audio and video technology of Sonnet, collaborative office, speech and teaching can be realized in the virtual scene. In their “spare time” users can also host a football game or a beach party outdoors, or even move an offline event online in a Metaverse sense.
Image from Virbela website
Talking about the development trend of real-time interaction and XR in the next 5-10 years, Hou yunyi said that as the performance of related hardware continues to improve, the user interaction experience is bound to increase. With the support of real-time interaction, multi-modal, cross-terminal, humanized perception and interactive experience will bring a qualitative leap, and Metaverse is no longer a distant dream. In addition, with the speeding up of the trend of global online, mobile applications are also occurred earth-shaking change, anytime, anywhere, without being limited by the distance, space and time of real-time audio and video technology will become the foundation of many application scenarios, and real-time interaction will like humans need air and water, daily need, as a ubiquitous.
Sonnet real-time audio and video technology to create low delay, high stability, high fluency of immersive experience
In VR/AR/MR application scenarios, users often encounter cross-regional and transnational cooperation, which makes the network situation more complicated. Sd-rtn ™, defined by Agora software, covers more than 200 countries and regions in the world. The global end-to-end network quality transmission rate is more than 99%, and the nearest network access and optimal network path transmission can be achieved in each region of the world, providing high-speed network services for users in any country/region of the world.
In remote collaboration, remote coaching and other scenarios, Agora’s solution can provide up to 1080P 60fps ultra hd video quality, allowing both parties to clearly see what they are collaborating on and give timely feedback. During a call, Sonnet’s two leading voice engines, Agora SOLO™ and NOVA™, combine sound fidelity, high performance and smooth and weak network experience to provide users with high-pitched interactive experience.
Virtual environments require a high degree of “spatial awareness” of audio. For example, in a competitive game or virtual office setting, you need to sense the distance and orientation of other users through footsteps, while spatial sound can make users feel more immersive. Agora’s solution supports 360° surround sound with perfect sense of location, distance and space. It can provide users with functions such as “distinguish position by listening to sound” and “distinguish distance by listening to sound” in specific scenes, further enhancing the immersive experience of content brought to users.
At present, Wipro, the world’s leading information technology, consulting and business process service company, HiLeia communication platform under BRIGHT Wind Platform, AR+AI enterprise service provider Bright Vision released AR glasses GLXSS ME (Multi-Edition), All remote assistance products of Nibiru adopt real-time audio and video solutions provided by Agora, which are widely used in collaborative office, intelligent manufacturing, telemedicine, remote power maintenance and many other scenarios.