v3.0.7
2024-10-04
Library updates
- [fix][sec] Upgrade Avro to 1.11.4 to address CVE-2024-47561 (#23394)
- [fix][sec] Upgrade vertx to 4.5.10 to address CVE-2024-8391 (#23338)
- [fix][sec][branch-3.0] Upgrade protobuf-java to 3.25.5 (#23356) (#23357)
- [fix] Bump commons-io:commons-io from 2.8.0 to 2.14.0 (#23393)
- [improve][misc] Upgrade Netty to 4.1.113 and netty-tcnative to 2.0.66 (#23255)
- [improve][misc] Upgrade jersey to 2.41 (#22290)
- [improve] Upgrade Pulsar Python client in docker image to 3.5.0 (#23377)
Broker
- [fix][broker] Cancel possible pending replay read in cancelPendingRead (#23384)
- [fix][broker] Execute the pending callbacks in order before ready for incoming requests (#23266)
- [fix][broker] Fix 'Disabled replicated subscriptions controller' logic and logging (#23142)
- [fix][broker] Fix authenticate order in AuthenticationProviderList (#23111)
- [fix][broker] Fix brokers still retry start replication after closed the topic (#23237)
- [fix][broker] Fix compatibility issues for PIP-344 (#23136)
- [fix][broker] Fix incomplete NAR file extraction which prevents broker from starting (#23274)
- [fix][broker] Fix out-of-order issues with ConsistentHashingStickyKeyConsumerSelector (#23327)
- [fix][broker] Fix shadow topics cannot be consumed when the entry is not cached (#23147)
- [fix][broker] Fix system topic can not be loaded up if it contains data offloaded (#23279)
- [fix][broker] Fix the bug that elected leader thinks it's a follower (#23138)
- [fix][broker] Handle the case when
getOwnedServiceUnits
fails gracefully (#23119) - [fix][broker] Internal reader of __change_events can not started after metadata store session rebuilt (#23018)
- [fix][broker] Let Pending ack handler can retry to init when encounters a metadata store error (#23153)
- [fix][broker] Skip reading entries from closed cursor. (#22751)
- [fix][broker] Topic can never be loaded up due to broker maintains a failed topic creation future (#23184)
- [fix][broker] fix exception may hidden and result in stuck when topic loading (#23102)
- [fix][broker] fix pulsar-admin topics stats-internal caused a BK client thread a deadlock (#23258)
- [fix][broker] fix replicated namespaces filter in filterAndUnloadMatchedNamespaceAsync (#23100)
- [fix][broker] fix the log format error in the AdminResource (#23278)
- [fix][broker] type cast on exceptions in exceptionally can lead to lost calls (#23117)
- [fix][broker]A failed consumer/producer future in ServerCnx can never be removed (#23123)
- [fix][broker][branch-3.0] Fail fast if the extensible load manager failed to start (#23297) (#23302)
- [fix][broker] StatsOutputStream: add string write function (#23227)
- [improve][broker] Add msgInReplay subscription stat and metric to improve Key_Shared observability (#23224)
- [improve][broker] Add retry for start service unit state channel (ExtensibleLoadManagerImpl only) (#23230)
- [improve][broker] Avoid subscription fenced error with consumer.seek whenever possible (#23163)
- [improve][broker] Explicitly close LB internal topics when playing a follower (ExtensibleLoadManagerImpl only) (#23144)
- [improve][broker] Improve pulsar_topic_load_failed metric to record correct failed time (#23199)
- [improve][broker] Optimize high CPU usage when consuming from topics with ongoing txn (#23189)
- [improve][broker] Optimize performance for checking max topics when the topic is a system topic (#23185)
- [improve][broker] Optimize the performance of individual acknowledgments (#23072)
- [improve][broker] Part 2 of PIP-370: add metrics "pulsar_replication_disconnected_count" (#23213)
- [improve][broker] Phase 1 of PIP-370 support disable create topics on remote cluster through replication (#23169)
- [improve][broker] Reduce the CPU pressure from the transaction buffer in rolling restarts (#23062)
- [improve][broker] Should notify bundle ownership listener onLoad event when ServiceUnitState start (ExtensibleLoadManagerImpl only) (#23152)
- [improve][broker] Support customized shadow managed ledger implementation (#23179)
- [improve][broker] Support to specify auth-plugin, auth-parameters and tls-enable arguments when init cluster metadata (#23087) (#23126)
- [improve][broker] Reuse method getAvailableBrokersAsync (#23099)
- [improve][admin] PIP-369 Introduce
unload
flag inns-isolation-policy set
call (#23120)
Client
- [fix] DLQ to handle bytes key properly (#23172)
- [fix][client] Copy orderingKey to retry letter topic and DLQ messages and fix bug in copying (#23182)
- [fix][client] Create the retry producer async (#23157)
- [fix][client] Fix for early hit
beforeConsume
for MultiTopicConsumer (#23141) - [fix][client] Fix timeout handling in Pulsar Admin client (#23128)
- [fix][client] TransactionCoordinatorClient support retry (#23081)
- [fix][client] fix negative message re-delivery twice issue (#20750)
- [fix][client] the nullValue in msgMetadata should be true by default (#22372)
- [improve][client] Add maxConnectionsPerHost and connectionMaxIdleSeconds to PulsarAdminBuilder (#22541)
- [improve][client] Don't print info logs for each schema loaded by client (#23206)
- [improve][client] Swallow Conscrypt ClassNotFoundException (#20371)
- [improve][client]Add new ServiceUrlProvider implementation: SameAuthParamsAutoClusterFailover (#23129)
- [improve][client]PIP-359:Support custom message listener executor for specific subscription (#22861)
Pulsar IO and Pulsar Functions
- [fix][fn] Make python install dependencies from requirements.txt (#20174)
- [fix][io] Upgrade mssql server docker tag in DebeziumMsSqlContainer (#23318)
- [improve][fn] Add support for overriding additionalJavaRuntimeArguments with PF_additionalJavaRuntimeArguments env (#23130)
- [fix][sql][branch-3.0] Fix UUID convert failed for JSON schema (#23292)
Others
- [feat] Add scripts for updating BK RocksDB ini files (#23178)
- [fix][log] Do not print error log if tenant/namespace does not exist when calling get topic metadata (#23291)
- [fix][log] Do not print warn log when concurrently publishing and switching ledgers (#23209)
- [fix][misc] Log Conscrypt security provider initialization warnings at debug level (#23364)
- [improve][misc] Improve AES-GCM cipher performance (#23122)
- [improve][misc] Optimize TLS performance by omitting extra buffer copies (#23115)
- [improve][proxy] Reuse authentication instance in pulsar-proxy (#23113)
Tests & CI
- [fix][test] Fix flaky SubscriptionSeekTest.testSeekIsByReceive (#23170)
- [fix][test] Fix flaky UnloadSubscriptionTest.testMultiConsumer (#23243)
- [fix][test] Fix flaky test LeaderElectionTest.revalidateLeaderWithinSameSession (#22383)
- [fix][build] Fix problem where git.commit.id.abbrev is missing in image tagging (#23337)
For the complete list, check the full changelog.