What to watch for this month
- Product dynamic
- The new PIP
- New features
- Bug fix
- Community dynamic
- Community Dynamics at home and abroad
- Technology of dry
About the Apache Pulsar
Apache Pulsar is the top project of Apache Software Foundation. It is the next generation cloud native distributed message flow platform, integrating message, storage and lightweight functional computing. It adopts the architecture design of computing and storage separation, supports multi-tenant, persistent storage, and multi-room cross-region data replication. It has strong consistency, high throughput, low latency and high scalability.
Introduction:
Dear friends, Pulsar community Monthly report is here as scheduled!
There are a lot of “big things” happening in Pulsar community this month. After eight months, the project had grown from 200 contributors to over 300. Pulsar has also been updated from 2.6.0 to 2.6.1, fixing previous bugs and incorporating 102 commitments from the community. Thanks for your support of Pulsar this month and keeping Apache Pulsar alive! (In no particular order, see if you made the list 🏆🏆) :
@Jianyun8023, @315157973, @ebyhr, @bewaremypower, @hangc0276, @Wolfstudy, @Sijie, @Srkukarni, @Jiazhai, @Merlimat, @Sijia-w, @jenni Fer88huang, @MEFL, @Codelipenghui, @Geetha-Rangaswamaiah, @Zhanghaou, @Robertindie, @bewaremypower, @Rudy2Steiner, @Gaoran10, @Ma Ssakam, @Zymap, @aahmed-se, @Marvincai, @bklyn
Product dynamic
Go Client version 0.2.0 has been released. For more information, please refer to the link below. Github.com/apache/puls…
🧰 new PIP
PIP 69: Schema design for Go client
Type safety is an important feature in a range of applications built on Pulsar. Apache Pulsar currently supports Schema Registry functionality. And Java, CPP, and Python Clients already support Schema-related functionality. To further improve the functionality of Go Client, we also need to support Schema Registry in Go Client.
For more details: github.com/apache/puls…
🧰 New features
Broker: support the Topic level set MaxUnackedMessagesOnConsumer github.com/apache/puls…
Broker: Support persistence at Topic level github.com/apache/puls…
Broker: Support deduplication at Topic level github.com/apache/puls…
Java Client: Supports batch message signing github.com/apache/puls…
Python CLient: Add oauth2 wrapper to Python CLient github.com/apache/puls…
Java Client: support the producers and the sender set autoPartitionsUpdateInterval github.com/apache/puls…
Transaction: Improved support for consuming Transaction messages github.com/apache/puls…
Transaction: Support for sending a produced transactional message to the Pulsar broker and executing the commit command github.com/apache/puls…
Topic Policy: Support for retention quotas at the Topic level github.com/apache/puls…
Topic policy: support the Topic level set MaxUnackMessagesPerSubscription github.com/apache/puls…
Topic Policy: Supports setting a topic-level message delay policy github.com/apache/puls…
Build: Upgrade Presto to version 332 github.com/apache/puls…
Pulsar-io hdfs2: added the configuration of creating subdirectories at the current time to facilitate batch processing of HDFS files github.com/apache/puls…
Broker: Increased support for ZooKeeper cache executor thread pool size configurable github.com/apache/puls…
Broker: Increased support for orderedExecutor thread count configurable github.com/apache/puls…
🔧 Bug fixes
Java Client: Avoid multiple subscriptions to the same topic github.com/apache/puls…
Broker: When querying messages via message ID, if the current Broker is not responsible for the topic, redirect to owner Broker github.com/apache/puls…
The Java Client: Repair PersistentAcknowledgmentsGroupingTracker of pendingBatchIndexAcks bitSet and batchSize github.com/apache/puls…
CPP Client: Fixes race conditions caused by Seeking or closing consumers github.com/apache/puls…
Security: Fix Pulsar component Security vulnerability github.com/apache/puls…
Security: use ‘allowTopicOperationAsync’ to check whether the original role is a superuser github.com/apache/puls…
Security: Differentiate authorization between source/sink/function operations github.com/apache/puls…
CPP client: Fix issuer_URL resolution failure in Oauth2 authentication github.com/apache/puls…
CPP client: Fix reference leak when creating reader github.com/apache/puls…
Admin Client: Ensure that a 404 error is returned when deleting a partition subject from a namespace that does not exist github.com/apache/puls…
Broker: How to create ledger timeout? github.com/apache/puls…
Community dynamics: Multiple milestones
On August 21, Apache Pulsar officially had more than 300 contributors for its GitHub program. It has only been 8 months since 200 people joined us. Thank you for your active participation and project sharing. Pulsar is more wonderful because of you!
More details can be found at ➡️ Apache Software Foundation’s top project Pulsar reaches a new milestone: more than 300 contributors worldwide!
StreamNative, the open source data company behind Apache Pulsar, has announced the launch of StreamNative Cloud, a Cloud service based on Apache Pulsar. The launch of Pulsar® -AS-A-Service (PaaS) makes Pulsar® -AS-A-Service (PaaS) a reality, accelerating Pulsar adoption and implementation, and helping enterprises advance their “flow first” strategy.
More details can be found at ➡️ StreamNative launches Pulsar cloud service to advance the enterprise “flow first” process
📣 version 2.6.1 launched August 21, Pulsar version 2.6.1 launched. This release fixes a number of issues in version 2.6.0, improves some features, adds support for OAuth2, It covers Broker, Pulsar SQL, Pulsar Functions, Go Function, Java Client and Cpp Client, further enriching Pulsar as a cloud native streaming data platform.
More details can be found at ➡️ Apache Pulsar 2.6.1 official release: 2.6.0 Feature Enhancement with OAuth2 support
📣 Pulsar and TiDB jointly launch a data application analysis solution for big data scenarios. Pulsar and TiDB jointly launch a solution to provide real-time, high-throughput and stable data output to meet users’ needs for application and analysis of various types of data in big data scenarios. It is widely applicable to log collection, monitoring data aggregation, streaming data processing, and online and offline analysis. At present, the solution has been implemented in many top companies in the industry, such as Banyu Children’s English (Internet online English education brand), Zhihu (Chinese Internet comprehensive content platform), And Shiji Information (hotel industry information system solution provider).
More details can be found at ➡️! Pulsar and TiDB jointly launched a data application analysis solution for big data scenarios
📣 TGIP series live
💙 TGIP – CN
- 019: How does Pulsar apply to data query
- 020: A brief introduction to the Pulsar Namespace policy
- 021: to cough up! Pulsar 2.6.1 release preview
- 022: Replication of subscription state? How to apply cross-room synchronization
TGIP – CN series all playback video reference b station link: www.bilibili.com/video/BV1T7…
💜 TGIP 018: From single-AZ to multi-AZ and geo-replication www.youtube.com/watch?v=Vc_…
📣 Collection of webinars
➡️ August 25: StreamNative webinar
Topic: Managing Real-time Data Teams Speaker: Jesse Anderson, Big Data Expert at the Big Data Institute
See the link below for a video review: www.youtube.com/watch?v=Owl…
➡️ September 9: The Israeli Java Community (java.il) Meetup
Addison Higham is a senior software engineer at StreamNative with extensive Experience in Apache projects
Registration link: meetup.com/JavaIL/even…
Technology of dry
Apache Pulsar – Part 2 – Global and Local Apache ZooKeeper in Apache Pulsar – Part 2 – Bartosz Konieczny www.waitingforcode.com/apache-puls…
That’s the Pulse tour for August. Apache Pulsar is growing fast, thanks for your support!
Apache Pulsar community encourages you to actively participate in the open source community, whether it is documentation, code, translation, or technical blog, you are welcome to actively participate and become Pulsar Contributor as soon as possible.
If you are not familiar with the Pulsar Contribute process, check out this tutorial to familiarize yourself with how to Contribute to Pulsar via GitHub: How to Contribute to Pulsar for beginners | How to Contribute to Pulsar for Non-technical people
Contribution projects optional:
- Pulsar Apache project
Github.com/apache/puls…
- Pulsar technical documentation translation
Github.com/apache/puls…