Recently, the 2021 Asia-Pacific Content Distribution Conference and CDN Summit was held in Beijing. As a new generation of real-time audio and video leader, Pai Yue Yun was invited to attend the conference to discuss the cutting-edge technology and future trend of industrial development with the industry.
Asia Pacific conference on content distribution is organized by the asia-pacific CDN industry union one thousand science and technology conference, is the world’s content flow technology and operational areas, one of the most important and largest activities, the main flow content platform oriented the CTO, director of operations and technical architect, popularize industry technology integration, innovation, given the CDN new value. After the sudden global epidemic, the RTC technology represented by Pai Le Yun ushered in the explosive growth of the demand for online real-time interaction and stood on the new trend of the industry.
At the conference, Zhen Xi, architect of Paileyun, delivered a keynote speech at the “Interactive Live” sub-forum, sharing Paileyun’s innovation and upgrading in real-time audio and video products and some best practices in the industry scene.
# 1
Real-time transmission to ensure the stability and efficiency of the global service
By providing Pano Cloud, customers can use the full stack of audio and video services. In order to solve the uncertainty of the Internet, the cloud communication service built on the Backbone real-time transmission acceleration network of Pano guarantees the global network must reach. It can hold very large concurrent scenes.
Zhen Xi introduced that PageCloud is the PaaS manufacturer of RTC. Through the integration of Pano SDK, customers can use Pano Cloud’s full-stack audio and video services, and provide professional solutions for customers in different industries.
Why does it need to build Pano Backbone? Is to address the uncertainty of the Internet. Based on the experience of video conferencing leaders WebEx and ZOOM in global large-scale audio and video conferencing, Pano Backboard has built its own Pano Backboard to carry large concurrent scenarios. The structure of micro-service ensures the stability and high availability of products. The terminal adopts intelligent routing and real-time detection of link quality. Adaptively adjust the networking and routing strategy, the client access to the nearest, efficient solution to the last kilometer problem.
# 2
Product innovation, the pursuit of the ultimate user experience
Based on product innovation and in order to solve the problems of users, Zhen Xi summarized the following landing scenarios for the future real-time audio and video communication industry.
Video annotation
How do we bring our eyes into focus during a video call or an entire screen share? Video tagging solves this problem, helping us find the key focus in the mass of information. When introducing WMPs in a financial scenario, circle important terms; Highlight your online Lego lessons; Very useful scenarios can be found in video conferencing, emergency command, remote maintenance and so on.
What is the future direction of video annotation? Is the AR. The current technology is to draw on a plane, and within a few visible years, it will be possible to draw labels directly on objects, from a plane to a three-dimensional space, which is a further iterative development of technology.
Multi-camera acquisition
In online teaching, due to the single device, we usually switch the camera or mobile phone, which will seriously affect the fluency of the teaching process and interrupt the course. Paileyun pursues to restore a complete offline classroom and create a sense of immersion in teaching. Multiple cameras can be turned on by a single device, and cameras can be arranged in advance to fully restore offline teaching scenes and send multi-channel video streams, greatly improving user experience.
The development of real-time communication is in the continuous pursuit of richer and more complete information input, from text to voice, in recent years developed into video, the definition and size of video is constantly improving. Multi-camera acquisition is a further enhancement of the current single camera image. Then, the stage that can be speculated is VR. It is the direction of future development to bring the whole virtual reality interaction to real-time communication, so that both sides of communication can reach communication in the virtual space.
Video correction
Online, there is a problem in fine arts teaching, mobile phone will be sheltered on the front and the picture on the side is collected is tilted, irregular, and pat LeYun through the calculation of geometric distortion parameter estimation, the mapping relationship between low complexity, such as high efficiency of millisecond video processing algorithms on the original video to correct processing, and in real time video, millisecond algorithm is particularly important. In the future, real-time video processing algorithms have great potential for development.
The interactive whiteboard
What determines the restoration degree of the data whiteboard? Mainly PPT dynamic effect, Paoleyun PPT dynamic effect restoration can be as high as 95%, can support PPT audio and video synchronous playback, the teacher end broadcast to a few seconds, the student end is also real-time synchronization. Temporary ideas and inspiration in the course can be shared with one click in the form of pictures. The offline whiteboard has boundaries, while the online whiteboard has no boundaries. Students will follow the lecturer’s perspective where they see it, which is perspective following. In case of problems, the interaction will enter into the function of multi-whiteboard. Each whiteboard is independent, and everyone can write or draw their own ideas and creativity. The presenter can choose any whiteboard to interact with.
“Our interactive whiteboard has great advantages. While using the data whiteboard architecture, it ensures the traditional advantages of less bandwidth consumption, higher clarity, ultra-low latency, etc., it supports the synchronous push and stream of the whiteboard to the CDN through the way of server to video stream, and at the same time it is recorded as a video file for storage and easy to watch back.” Introduced by Zhen Xi.
The images stored in the whiteboard transcoding are sent to the client locally, only the data of synchronous paging. It can be imagined that its bandwidth is very small, while the cloud data maintenance ability ensures that the data of the whiteboard will continue to exist when there is an abnormality, and the teaching can continue when you return to the room.
# 3
Scene practice, landing the value of technical innovation
Based on the development trend of the future art class and the leading technology to create the next generation of online art teaching solutions, Pai Le Yun gave such an answer.
Support dual-channel camera, one way to shoot students and teachers, one way to shoot on both sides of the drawing board; Support the size stream switch between portrait and artboard to ensure the bandwidth is used in the right place; The whiteboard supports synchronous sharing of teaching materials, sharing high-definition teaching materials. In art class, the clarity of drawing is very important. Real-time correction and annotation, to ensure that the painting paper is straightened in the video, real-time annotation of the key points and details of the painting. User experience is one of the core competencies of online education products, and it is also a relatively clear evaluation method in the lack of evaluation criteria in the data education track. Because subject education is very simple, achievement is everything, but quality education is difficult to judge by subjective evaluation. The comfort of the teaching process has become the intuitive feeling of the students’ learning experience, and it is also an important factor affecting the referral rate. Zhen Xi introduced: “Pai Le Yun customizes a lot of abilities in art teaching scenes, and also gives users the best experience under the current best technology. There’s a lot more to it, not just in art teaching, but in a lot of other Settings.” Looking forward to the future, Pale Cloud will continue to polish its products and technologies, deepen the industry scene, solve the pain points in more real-time online interaction scenes for enterprises and developers, and find the certainty of user experience growth in the uncertain future.