Bytedance’s overseas technical team has achieved the latest breakthroughs in the global video coding field.
According to the website of JVET, a joint video expert group, ByteDance AVG (Advanced Video Team) launched a technical proposal for video compression in February this year, which can save at least 13 percent of storage and bandwidth while optimizing compression quality. For example, a 180-minute H.266/VVC hd video (1080P resolution) requires about 3GB of data volume, compared to just 2.6GB with the new technology. This is the best performance gain for a single intelligent coding tool publicly available in the industry.
Bytedance AVG has established a research and development team in California, including senior researchers from Qualcomm, Microsoft, Intel and other giants, as well as the new generation from top universities at home and abroad. During JVET’s development of h.266 /VVC, byteDance AVG submitted a total of 260+ technical proposals, of which 130+ were accepted. The number of accepted proposals and adoption rate are among the highest in the world, and it is one of the main contributors to the core algorithm of H.266/VVC.
Video is a dynamic image sequence connected by one picture. Video encoding and decoding is the core technology of video application, which compresses and digitally encodes images to transmit high-quality video data with the smallest possible bandwidth. H.266/VVC can reduce the video bit rate to half of the previous generation standard H.265/HEVC without affecting the picture quality. Internet speeds that were supposed to be good for standard definition videos can also play hd videos smoothly.
The new algorithm proposed by Bytedance AVG aims to construct a filter (DAM) to reduce video compression distortion through deep learning technology. The backbone is a deep convolutional network based on residual unit stacking, complemented by adaptive model selection to maximize the adaptation of complex natural video. Residual unit refers to the connection, by introducing jump layer allows network focus on the changes on the residual error of the video image frames between residual has the same effect, such as wulin duel, “a flash of light sword”, for the most part every frame image content is the same, the flashing sword form residual light, this is the video compression coding focus on objects.
Experimental results show that, compared with h.266 /VVC, bytedance DAM solution can significantly improve the performance of video coding. The brightness signal Y can achieve 10.28% performance gain, and the two chrominance signals U and V can also achieve 28.22% and 27.97% performance gain, respectively. While the video quality is improved, the data volume can be reduced by at least 13%.
Figure: Test case from the INTERNATIONAL Standards Organization’s test video
It is reported that BYtedance AVG has independently developed the BVC2.0 encoder and participated in the international authoritative MSU 2020 video encoder competition for the first time, winning the first place in four evaluation indicators. AVG’s research achievements will also be applied through the upgrading of BVC encoders, including the video content processing of Apps such as Douyin, Watermelon Video and Toutiao, as well as the infrastructure fields such as cloud computing and cloud games, so as to bring users higher high-definition and smoother video experience.
In addition to deeply participating in the formulation of international video standards, AVG has also made important contributions to AVS3, a new generation of domestic video compression standards, including block partitioning, motion vector coding and prediction, color – brightness prediction and other original technologies adopted by AVS3 video standards. Bytedance is the only Internet company to win the 2019 AVS Industry Technology Innovation Proposal Award.
Dr. Zhang Li from Bytedance AVG said that the video compression standard, as a standard that service providers must follow, not only contains inestimable commercial value, but also brings real convenience to users. Bytedance will continue to innovate and export its technical capabilities through standard setting and product development, and work with the industry to provide users with better video services.
Welcome to Bytedance Technical Team
Resume mailing address: [email protected]