Summary: RTS NetSDK is the cornerstone of future live and communications integrated SDK. On top of RTS NetSDK, add a Multimedia Framework, and QoS message processing, can constitute an integrated SDK. This is good news for customers who already have their own Framework, which eliminates the need to develop separate software for live and communication, and also simplifies the implementation of live and MAC scenarios.
This summer, there’s nothing like a good Olympic game. But watching games live on video platforms has its pains: “lag” and “delay”. Limited by different regions, complex network conditions, transmission speed and other reasons, when you are still anxious for the match point, the next door has been heard cheers, watch the game interest instantly lost. In order to create a more smooth, stable and low-latency live broadcast experience, more and more enterprises pay attention to the application of low-latency live broadcast technology.
Aliyun real-time Streaming (RTS) is based on the live video broadcast, to optimize the whole link delay monitoring, CDN transmission protocol transformation, UDP and other underlying technologies. By integrating the SDK of the live broadcast player end, it supports the millisecond delay broadcast capability between nodes in tens of millions of concurrent scenarios. It makes up for the problem of 3~6 seconds delay of traditional live broadcast, and ensures the ultimate live viewing experience with low delay, low latency and smooth second start.
In order to reduce the end-to-end delay of live broadcasting, Alibaba Cloud officially launched the Global Real Time Network (GRTN) in 2020, which is a communication level streaming media transmission Network with ultra-low latency and fully distributed sinking deployed on edge cloud nodes. Supports video conferencing, live video streaming, and real-time audio and video services. To use the short delay/real-time transmission service provided by GRTN, clients can access through the webrTC capability of the browser or develop their own client protocol stack to access.
What is RTS NetSDK?
Low delay live streaming SDK is composed of RTS NetSDK, Push stream SDK and Player SDK. Among them, the push stream SDK sends audio and video frames output by the encoder to THE RTS NetSDK, and the player SDK reads audio PCM data and video H264/H265 data in the form of frames from THE RTS NetSDK.
RTS NetSDK is based on GRTN development running on the client protocol stack. RTS NetSDK communicates with SFU on GRTN through UDP transport layer protocol to send and receive audio and video data. Considering the unknown network conditions, RTS NetSDK integrates WebRTC QoS algorithm to adapt to the network changes, so as to provide high-quality audio and video transmission services. RTS NetSDK’s lightweight design makes it easy to integrate with open source frameworks such as FFMPEG and OBS.
RTS NetSDK takes on the bridge of push and pull flow docking with Ali Cloud RTS service. With small packet size, simple integration and no invasion to existing business as the main features, IT helps live streaming customers to upgrade traditional live streaming to Ali Cloud RTS live streaming simply and quickly.
RTS NetSDK support platform, Android/iOS/MacOS/Linux/Windows/RTOS, support multiple open source project integrated access code, ijkPlayer, obs, FFmpeg. And Ali Cloud push stream SDK and player SDK has been built in the RTS live stream push pull capability.
RTMP is transmitted over TCP, RTS is transmitted over UDP. Under the condition of sufficient stable network bandwidth, RTS has no advantages over RTMP, but this ideal situation is difficult to guarantee. Due to the differences in transport protocols, RTMP does not have many QoS methods for the changing network and completely relies on TCP congestion control. This congestion control does not aim for low latency. Aliyun’s RTS introduces WebRTC’S QoS technology, which has a better tolerance for network packet loss. Excellent bandwidth estimation and congestion control, providing a nuanced network usage strategy.
In addition, RTMP is no longer available on web pages after Adobe Flash Player stops updating. Customers can choose either HLS technology with very large delays or WebRTC technology. The RTS H5 version is essentially WebRTC and can run on the web.
Product advantage
Low latency
HLS live broadcast has a delay of at least one gop due to its TS file slice — the whole piece read mechanism. In order to ensure smooth playback of RTMP and FLV live broadcast, the client will always keep the cache for more than 5 seconds.
Ali Cloud RTS live broadcast, based on UDP transmission technology, the whole link for delay optimization, the latest V1.8.0 version has been able to reduce the delay to about 500 milliseconds.
Weak resistance network
Aliyun RTS live broadcast is based on UDP transmission. Through the application of WebRTC advanced technology (such as BWE, Jitter Buffer, NetEQ, FEC, NACK and other QoS mechanisms) and self-developed anti-weak network technology, in the complex and volatile user network environment, It has better fluency and latency than live streaming based on TCP.
Package is small in size
RTS NetSDK has a lightweight package size. Take the latest versions of Android and iOS for example:
Easy to integrate
Most of the live streaming customers have formed the ability of live streaming and live streaming. The RTS NetSDK is integrated into the customer’s existing SDKS as a library, enabling low-cost upgrades and compatibility with previous business logic. Ali Cloud RTS live streaming has supported all the basic features of traditional live streaming.
Product Application Architecture
RTS live will support the basic full capabilities of traditional live, such as live recording, anti-thievery, guide station, etc.
RTS NetSDK can be integrated into a variety of pull-side products. In addition to provide integration to ffPlay, ijkPlayer source code, customers can use directly or reference to modify. Ali Cloud Player SDK has built-in RTS NetSDK streaming capability.
RTS NetSDK can also be integrated into the side of the product to the RTS NetSDK to push streaming products RTS live streaming capabilities, but also provides integration into ffMPEG, OBS source code. Ali Cloud push stream SDK has built-in RTS NetSDK push stream capability.
The RTS NetSDK is the cornerstone of a future live and communications integrated SDK. On top of RTS NetSDK, add a Multimedia Framework, and QoS message processing, can constitute an integrated SDK. This is good news for customers who already have their own Framework, which eliminates the need to develop separate software for live and communication, and also simplifies the implementation of live and MAC scenarios.
The original link
This article is ali Cloud original content, shall not be reproduced without permission.