Front-line developers have been facing great learning pressure. In addition to solving daily bugs and problems after the launch of the business, they also have to face the constant release and update of open source software.
so
“I can’t learn anymore!!”
But wouldn’t it be great if every new release of the software could help you circle the highlights, along with a detailed explanation of new features, major changes, and overall benefits?
On June 14, the first quarter of the Big data +AI Meetup series jointly organized by Alibaba’s Computing Platform Business Division and Alibaba Cloud Developer community will be launched. This Meetup invited a number of technical experts from Alibaba, Databricks, Kuaishui, netease Cloud Music and other domestic and foreign technical experts to gather together. Discuss hot topics in big data and AI with you!
Meetup window
- Flink, Spark, Alink and other big data hot open source software core developers help you circle the highlights of the latest release
- What the real-time data warehouse, data lake, and HSAP architecture can do once and for all
- More frontline production environment combat, Spring Festival Gala Fast hands project, netease cloud music Flink + Kafka landing practice of exclusive precious experience sharing
Full agenda for Meetup
This article will share the detailed topic profiles of 3 senior technical experts in the morning half of the Meetup.
01 Take an in-depth look at the new features of Apache Spark 3.0
Rossie | Databricks Spark r&d director
Introduction:
Apache Spark 3.0 aims to be faster, easier, and smarter, with more than 3,000 resolved JIRas available in this release. Covers the following features: accelerator-aware scheduling, adaptive query execution, dynamic partition pruning, join hints, new query explain, better ANSI compliance, observable metrics, new UI for structured streaming, new built-in functions, new unified interface for Pandas UDF, and various enhancements in the built-in data sources [e.g., parquet, ORC and JDBC].
In this talk, we will discuss these new and exciting feature points and important plans for the future, as well as share and demonstrate more examples with the Chinese community.
Evolution of real-time data warehouse from Lambda architecture to HSAP
Jiang Weihua (fruit) | alibaba senior technical experts
Introduction:
Lambda architecture is the standard scheme for real-time data warehousing at present, but its disadvantages are becoming more and more obvious with the demand for more refined business. Thus, the simplified architecture HSAP arises at the historic moment. What is HSAP and how should HSAP be designed for smooth implementation? After HSAP landing, how to achieve the data warehouse to the front of the empowerment? In this sharing, we will explain them all. The main contents include:
- Pain points in the Lambda architecture
- What is the HSAP
- HSAP lands smoothly –Hologres
- Real-time data warehouse based on Hologres
Alink: Improving the usability of machine learning platforms based on Flink
Yang xu algorithm (play) | alibaba senior experts
Introduction:
Alink is a Flink-based streaming batch machine learning platform that provides a series of algorithms to help handle a variety of machine learning tasks, such as statistical analysis, machine learning, real-time prediction, personalized recommendations, and exception detection. In addition to the Java API, PyAlink is also available, which can be easily deployed to standalone and cluster environments, and used by Jupyter, Zepplin, and other Notebooks. Alink has supported a number of application scenarios within Alibaba and announced open source at The Flink Forward Asia conference in November 2019. Since then, new versions have been released iteratively to enhance functionality and ease of use.
How to watch
- Time: 10:00 — 18:00, June 14
- Live links: booking developer.aliyun.com/live/2894?s…
- How to register: Scan the qr code below to make an appointment
The above is the detailed introduction of the morning topics of this Meetup. We are looking forward to your coming to the big data +AI Meetup live broadcast room at 10:00 on June 14. There are more exquisite gifts, you can get them if you participate in the interaction! Click the link below to schedule Meetup live ~
Meet up live > > developer.aliyun.com/live/2894?s…
For more Meetup information, scan the qr code below for group consultation.
(Big data + AI Meetup Group)