Introduction: welcome to nailing scan qr code at the bottom of the article into the herd of EMR Studio users communicate directly and lecturer discussion ~ click the following link to watch live directly playback: developer.aliyun.com/live/247106

Open source big data community & Ali Cloud EMR series broadcast the 12th issue

** Topics: **Flink on Zeppelin Stream computing Best practices

** Lecturer: ** Jian Feng, head of Aliyun EMR data development platform

Content framework:

  • Overview of big data
  • Flink learning framework
  • Best practices for stream computing on EMR Studio
  • demo

I. Overview of big data

  • Big Data processing ETL (Data → Data)
  • Big Data Analysis BI (Data → Dashboard)
  • Machine learning AI (Data → Model)

Second, Flink learning framework

Flink points

  • Stateful
  • Time
  • Flink Architecture
  • Flink API
  • Flink Configuration
  • Flink Log

Stateful:

  • Why

• Timeliness of flow calculations

• Unbounded stream computing

  • When

The Window,

• the Join

The Pattern,

  • How

• statebackend

Time

  • Event time
  • Processing time
  • Watermark

Flink Architecture

Flink API

Flink Configuration

  • Cluster Configuration
  • Job Configuration
  • Statebackend
  • Resource Manager
  • SQL/Python

Reference document: * * * * ci.apache.org/projects/fl…

Flink Log

Best practices for stream computing on EMR Studio

EMR Studio features:

  • Compatible open source components EMR Studio has been optimized and enhanced from Apache Zeppelin, Jupyter Notebook, Apache Airflow.

  • Multiple clusters can be connected
  • ADAPTS to multiple computing engines
  • Interactive development + job scheduling seamless
  • Applicable to various big data application scenarios
  • Computing storage separation

Flink Clients

Flink on Zeppelin (Phase 1) – Interactive Flink Client

Flink on Zeppelin (Phase 2) – Interactive JobManager

Flinkon Zeppelin main Feature

Four, presentations,

For specific product introduction and demonstration, you can click the following link to watch the replay directly:

developer.aliyun.com/live/247106

The original link

This article is the original content of Aliyun and shall not be reproduced without permission.