This paper will explain in detail how to develop a real-time communication application with video annotation, multi-stream video, 1080P hd audio and video call, real-time image transmission and other functions based on Tangqiao real-time audio and video SDK. With the hospital side business functions such as registration and login, patient consultation data presentation, a remote consultation system can be developed.

I. How to develop a set of audio and video modules of 5G remote consultation system based on Tangqiao SDK

The following is an example of integrating a set of Windows terminal remote consultation system audio and video module. • Microsoft Visual Studio 2015 • Support Windows 7 or above on Windows devices • Techbridge is available Follow these steps to integrate the SCC Voice call/video call/Whiteboard annotation SDK into your project.

  1. • Download the latest Tunbridge real-time audio and video SDK from the SDK based on the application scenario, and decompress and open it. • Copy the bin\release\ DLLS or bin\release\libs folder from the download package to your project folder, depending on your development environment.
  2. Configure project Properties In the Solution Explorer window, right click the project name and click properties to perform the following configuration. When complete, click OK. • Go to THE C/C++ > General > Add Include directory menu, click Edit, and type $(SolutionDir)include in the pop-up window. • Go to the Linker > General > Additional Libraries directory menu, click Edit, and type $(SolutionDir) in the pop-up window. • Go to the Linker > Input > Add Dependencies menu, click Edit, and type sccEngine.lib in the pop-up window. Realize voice/video/interaction/whiteboard and other functions

After the above configuration, you can create related projects through the console after registration. After the project is created, you can obtain the App Key and App Secret of the project on the project management page. By calling the relevant API interface, the related functions can be implemented. It only takes 30 minutes.

Second, what are the features and highlights

It is worth mentioning that, compared with the traditional real-time audio and video SDK providers, The Real-time audio and video SDK of Tangqiao has made more functional refinement and product performance upgrade for the hospital scene

  1. Through the customized development of the interface of Tang Bridge RTC PaaS platform, different types of ultrasound equipment images can be connected to the platform, and the SDK interface is provided for the upper application system to call.
  2. Video multi-streaming Tangbridge RTC PaaS platform can support a single terminal to compile multi-channel video streams at the same time, and deliver the multi-channel video streams synchronously to the demand end via the PaaS central cloud platform on demand. The clinical sonographer at the ultrasound terminal side examined the patient, and the resulting ultrasound images and the doctor’s operation techniques were transferred to the consultation terminal side in real time through the real-time communication server, and the latency generated in the middle was less than 100ms.
  3. Video resolution adaptive priority in most application scenarios, in order to ensure the fluency, remote collaboration to the requirement of audio and video transmission technology usually give priority to your fluency, but under the scenarios of remote diagnosis, in order to ensure the accuracy of the diagnosis, need to make sure that ultra high definition, tunbridge technology RTC PaaS independence some clear priority strategy, It is more suitable for remote consultation and remote video reading in the medical industry, and the switch of fluency and emotion priority is set to adapt to the demands of different industries on audio and video transmission strategies.
  4. The intelligent AEC algorithm of THE RTC PaaS platform of Tang Bridge Technology can better guarantee the clarity of the real-time communication between multiple parties and adapt to 500 mobile terminals
  5. Anti-network wobble technology + packet loss compensation, to ensure the timeliness and fluency of audio and video transmission services in weak network environment
  6. Real-time network monitoring, adaptive bit rate, output the best audio and video quality and playback experience
  7. Supports public-private hybrid deployment, which is flexible and convenient, saves traffic, and greatly reduces the use cost

Remote consultation based on hd real-time audio and video module can realize remote real-time 1080P hd audio and video transmission, real-time image data transmission, whiteboard interaction and other functions. It is widely used in remote conference, remote consultation, remote education, remote endoscopy and other surgical guidance.