About the Apache Pulsar

Apache Pulsar is the top project of Apache Software Foundation. It is the next generation cloud native distributed message flow platform, integrating message, storage and lightweight functional computing. It adopts the architecture design of computing and storage separation, supports multi-tenant, persistent storage, and multi-room cross-region data replication. It has strong consistency, high throughput, low latency and high scalability.

Introduction:

Guys, Pulsar Community Weekly is here!

This Pulsar Community Weekly presents Pulsar Client, Transaction, OAuth2 authentication, Functions, security, etc., to help the community keep track of Pulsar projects and community progress. It also makes it easier for you to get involved in the Pulsar community!

Thanks for contributing to Apache Pulsar this week (in no particular order, see if you made the list 🏆🏆) :

@Gaoran10, @315157973, @Zhanghaou, @hangc0276, @Technoboy-, @equanz, @Srkukarni, @codelipenghui, @Marvincai, @Aloyszhang, @Kellyfj , @Zymap, @WolfStudy, @Jerrypeng, @Cimura, @tuteng, @Jianyun8023, @Jennifer88Huang, @Robertindie, @bewaremypower, @Massakam, @Bklyn, @Mkozioro, @Jiazhai, @LukeStephenson-Zendesk, @Sijia-W, @yuku, @aloyszhang, @hangc0276, @huanli-Meng, @David-Streamlio

Next, let’s take a look at the developments that are worth your attention from 2009-05 to 2009-11.

Important features

Due to the large number of PR, only the major PR progress is listed, excluding all the PR developments of this week that have been merged into the main branch of Pulsar

🧰 Topic Policy: You can set, obtain, and delete inactiveTopicPolicies at the Topic level. PR address: github.com/apache/puls… Contributors: @ 315157973

🧰 Bookie: adding bookkeeperClientMinNumRacksPerWriteQuorum and bookkeeperClientEnforceMinNumRacksPerWriteQuorum configuration options. PR address: github.com/apache/puls… Contributor: @mkozioro

🧰 Topic Policy: Supports setting, obtaining, and deleting maxConsumers at the Topic level. PR address: github.com/apache/puls… Contributor: @Zhanghaou

🧰 Transaction: Update subscription to confirm abort process. PR address: github.com/apache/puls… Contributor: @gaoran10

🧰 Topic Policy: Fix dispatchRate coverage order. PR address: github.com/apache/puls… Contributor: @315157973

🧰 C++ Client: C++ Client supports key-based batch processing. PR address: github.com/apache/puls… Contributors: @ BewareMyPower

🧰 Pulsar Perf: Supports setting the message primary key for consumer in Key_Shared subscription mode. PR address: github.com/apache/puls… Contributor: @315157973

🧰 OAuth2: Obtain the OAuth2 Token endpoint from the well-known Configuration path. PR address: github.com/apache/puls… Contributor: @zymap

🧰 Functions: Pulsar Functions support specifying subscription locations. PR address: github.com/apache/puls… Contributor: @wolfStudy

🧰 Topic Policy: Supports setting, retrieving, and deleting maxConsumers per subscription at the Topic level. PR address: github.com/apache/puls… Contributor: @hangc0276

Important Bug fixes

Due to the large number of fixes, only the important fixes are listed, not including all the dynamic fixes of this week have been merged into the main branch of Pulsar

🔧 Functions: optimizes the close() process of the batch source when an exception occurs. PR address: github.com/apache/puls… Contributor: @jerrypeng

🔧 Functions: Improved batch internal topic cleanup operations. PR address: github.com/apache/puls… Contributor: @jerrypeng

🔧 Security: Upgrade SnakeyAML to version 1.26. PR address: github.com/apache/puls… Contributor: @wolfStudy

🔧 Broker: Avoid double-counting a ServerCnx publish cache multiple times when checking the Broker side publish cache. PR address: github.com/apache/puls… Contributor: @aloyszhang

🔧 OAuth2: Fix Null Exception when using OAuth2 authentication plug-in to start proxy service. PR address: github.com/apache/puls… Contributor: @zymap

🔧 Broker: repair in Key_Shared subscription mode when the message is distributed to the consumer’s IndexOutOfBoundsException anomalies. PR address: github.com/apache/puls… Contributors: @ codelipenghui

Events and news

📣 TGIP weekly live stream: Pulsar and its ecosystem

IO /resource#tg… streamnative. IO /resource#tg…

📣 September 9, “Apache Pulsar: Under the Hood for Java Developers” by Addison Higham, StreamNative Senior Software Engineer with extensive Apache project experience.

PPT link: www.slideshare.net/streamnativ… Video replay: www.youtube.com/watch?v=8Dk…

📣 Pulsar Summit Asia 2020

Submit a topic or register to attend: pulsar-summit.org/zh/event/as…

📣 Activity Notice

➡ ️ on September 29 to October 1: ApacheCon: Pulsar Apache/BookKeeper special registration link: www.apachecon.com/acah2020/tr…

📣 Recommended reading

➡ ️ StreamNative Cloud operational guidelines for school official cites use: StreamNative Cloud – Getting Started: StreamNative. IO/blog/tech / 2…


As a global open source project, Apache Pulsar has over 300 contributors, 6.5K+ Star, and 1.6K+ Fork as of September 11, 2020. The Apache Pulsar project continues to grow and advance thanks to the contributions of community developers around the world.

Look forward to next week’s Apache Pulsar weekly!

If you also want to be a contributor to the Apache Pulsar project, check out the link below to join us:

  • Contribution to the official guidelines: pulsar.apache.org/en/contribu…