1.46.5

• [Java] Delete segment files without renaming so that the Archive conductor thread will not be blocked for a long period of time.
• [Java] Remove expensive file existence checks when scheduling segment file deletion.

1.46.4

• [C] Align loss and SMs handling between Java and C media drivers.

1.44.3

• [C] Align loss and SMs handling between Java and C media drivers.

1.46.2

• [Java] Fix ClusterBackup issue whereby upon restart it could end up reading data from the previously started replay thus failing to recover the log.

1.46.1

• [Java] Fail build on JavaDoc errors.
• [Java] Remove Nashorn dependency.
• [Java] Upgrade to Checkstyle 10.18.0.
• [Java] Upgrade to Mockito 5.13.0.
• [Java] Upgrade to ByteBuddy 1.15.1.

1.46.0

Breaking changes

• JDK 17 is required for compiling and running!

Changelog

• [Java] Use new Selector API and fix samples.
• [Java] Fix config validation on JDK 17  by using an external Nashorn ScriptEngine.
• [CI] Execute tests using ubuntu-24.04 and macos-latest.
• [Java] Upgrade to Agrona 1.23.0.
• [Java] Upgrade to SBE 1.33.0.
• [Java] Upgrade to Gradle 8.10.
• [Java] Upgrade to ByteBuddy 1.15.0.
• [Java] Upgrade to Shadow 8.3.0.
• [Java] Upgrade to bnd 7.0.0.
• [Java] Upgrade to Mockito 5.12.0.
• [Java] Upgrade to AsciiDoctor 2.5.13.
• [Java] Upgrade to JGit 6.10.0.202406032230-r.
• [Java] Force ASM 9.7.

1.45.0

Noteworthy Changes

• Per-Stream Session Limits
  • Allows users to limit the number of different sessions (i.e. distinct publication images) that can be created connecting to the same subscription (channel & stream). This can be used to avoid resource exhaustion the driver hosting the subscription, when clients on other drivers are over zealously creating publications.
• Infer Group Subscriptions for Recovery Behaviour
  • When using Multi-Destination Cast, if the user wants to make use of group semantics for nakking and retransmission, then previously group=true needed to be added to the channel configuration on the subscription. Failing to do so would potentially cause excessive nakking. This feature will set a flag on the SETUP message that the subscription can use to automate the setting of this configuration option. Setting group=true/false will override the derived value.
• Static Counters
  • Add new API to create static counters whose lifetime is decoupled from an Aeron client instance that created them. Unlike the normal counters which are deleted when an Aeron client is closed or times out, the static counters remain valid until the MediaDriver is closed.
  • Static counters are similar to the system counters which are created by the MediaDriver upon startup. Such counters cannot be delete and only one instance of each counter can exist per MediaDriver instance. A static counter is identified by a tuple <typeId, registrationId> which are specified at the creation time. Calling addStaticCounter with the same <typeId, registrationId> multiple times will only create a counter once with subsequent calls returning the id of an existing counter. An exception will be thrown upon an attempt to specify <typeId, registrationId> of an existing non-static counter.
• Archive Integration of Response Channels
  • Users of the AeronArchive client can make use of response channels for control, replay and replication communication paths.
• Archive Logging Improvements
  • To increase visiblity of replay and recording session state changes.
  • Enable either REPLAY_SESSION_STATE_CHANGE or RECORDING_SESSION_STATE_CHANGE when configuring the aeron agent.
• ReplayMerge Backoff
  • To slow down internal state transitions that involve calls to ‘get max recorded position’.
  • Reduces network traffic.
  • Greatly reduces log output when debugging is enabled.
• RetransmitHandler Improvements
  • On unicast channels, a received NAK may immediately replace a previous received NAK so long as the offset has increased.
• Retransmitted Bytes Counter
  • To understand network conditions, it can be useful to know how many bytes have been retransmitted due to reception of NAKs.
  • We have exposed a new counter “Retransmitted bytes”, which serves as an approximate indicator of this information.
  • The counter only approximates the true value, as MDC retransmits are only recorded once, rather than N times (once for each destination). It is also worth noting that the retransmitted bytes are not included in the total bytes sent counter value. We may improve these aspects in the future.
• C++ API Deprecation
  • Aeron currently has two C++ APIs, a pure C++ version and a wrapper over the C API. This release we are no longer adding new features to the C++ API. This include being able to offer raw uint8_t * values and the new static counters feature.

Changelog

• [Java Cluster] IngressAdapter to delegate to ConsensusModuleAgent when schema id is unknown
• [C++ Wrapper] Correctly implement tracking of context on the header.
• [C/C++] Do not compile with -Ofast compilation level.
• [C/C++] Pass custom optimization level to the MSVC compiler.
• [Build] Download and install CMake as part of the build process to ensure latest version of CMake.
• [C] Tidy up aeron_reallocf to work correctly on allocation failure.
• [C Driver] Expose try_connect_stream method for use from within ATS.
• [C Driver] Remove unconnected stream message.
• [C Driver] Fix string format for AERON_SET_ERROR arguments.
• [C/C++/Java] Add per channel untethered window limit and resting timeouts (#1588)
• [C++ Wrapper] Add findByTypeIdAndRegistrationId to C++ Wrapper.
• [Java Driver] Pre-start async task executor threads to avoid inheriting affinity from the conductor thread.
• [Java Cluster] Print serviceId when throwing "ack out of sequence" exception.
• [C++] Fixed set thread name. (#1594)
• [Java/C++ Archive] Use response channels in the Archive Client (#1560)
• [PS] Add Powershell script for Windows build.
• [C/Java Driver] Do not resolve self hostname when starting MediaDriver to avoid a DNS-induced stall. Make resolverName required when driver name resolution is used.
• [Java/C/C++ Client] Propagate context though assembled header when using the buffer builder.
• [Java] Fix FixedLossGenerator to not drop frames before the specified "drop region".
• [C/Java Driver] Expose counter for number of bytes retransmitted.
• [Java Cluster] Remove redundant param.
• [C] Move validation earlier in the flow to prevents leaks in ATS on validation failure.
• [Java Samples] Use context instead of image by session id to resolve Image on request message.
• [C/Java Driver] Add session limits for a stream to prevent resource exhaustion of resources on drivers hosting subscriptions (#1598)
• [Java Cluster] Add support for installing schema extensions into the ConsensusModule.
• [Java Samples] Change response channels sample to use controlled poll to prevent response channel test failures.
• [Java] Add some additional error test to ReplayMerge and test for concurrent ReplayMerges along with additional error reporting.
• [C++ Archive] Rethrow original exception in ReplayMerge so information is not lost. #1587
• [C] add and use aeron_mkdir_recursive (#1602)
• [Java] Version interface to allow testing usage of it (#1605)
• [Java] Include file name when mark file version validation fails.
• [Java] Correct offsets for response setup flyweight in ReceiveChannelEndpointThreadLocals.
• [Java] Default cluster log flow control to driver default which will commonly be max now that overruns can go up to half a term.
• [Java Archive] Assign client name to Archive's Aeron client.
• [Java Cluster] Assign client name to Cluster Aeron clients.
• [C++/Java Client] Pre-touch mapped log buffers on the client if Aeron.Context.preTouchMappedMemory() returns true, i.e. client configuration takes precedence over channel parameters and media driver configuration.
• [Java Cluster] Delegate decision on unknown schema to consensus agent
• [Java Cluster] Ensure service count is zero when consensus module extension is installed.
• [C/C++/Java] Annotations to support config/counters documentation/validation (#1593)
• [C/Java Driver] Add unicast semantics to RetransmitHandler (#1603)
• [Java Cluster] Add archive and egress response endpoints for cluster and make them optional.
• [Java Cluster] Remove default for cluster services directory configuration and leave resolution of that value until conclude.
• [Java Archive] Use publication.availableWindow instead of looking up the pubLmt counter.
• [Java Cluster] First cut at consensus module extension integration.
• [C Driver] Fixes for fixed loss interceptor used for testing.
• [Java Cluster] Remove unused params.
• [Java Archive] Separate lines for debugging.
• [Java Cluster] Provide access to archive and aeron for consensus module extension.
• [Java Cluster] Delegate cluster session creation to extension if available.
• [Java Cluster] delegate callbacks to extension on state changes.
• [C/Java Driver] Track EOS for each receiver connected to the NetworkPublication (#1606)
• [C Client] Declare a volatile pointer to aeron_image_list_stct instead of a pointer to a volatile struct. (#1607)
• [Java Cluster] A more decoupled approach to ConsensusModuleExtension.
• [Java Cluster] Provide access to log publication after an election for consensus module extension.
• [Java] Improve error messages when publication errors occur.
• [Java Cluster] Consensus module extension API refinements.
• [Java Cluster] Add replay of session open and close delegation to consensus module extension.
• [Java Cluster] Add replay of extension message delegation to consensus module extension.
• [Java Cluster] ConsensusControlState to be passed from Agent to Extension and allows control.
• [C/C++ Client] Use aeron-client-conductor as a client conductor agent name across all implementations.
• [Java Cluster] pass actingVersion to onMessage of ConsensusModuleExtension
• [Java] Version generated class to have toString
• [Bash] Add option to disable C++ Archive API.
• [Java Cluster] Add ability to access response publication for a session and only update keepalive status when open.
• [Java Cluster] Handle cluster extension messages on egress listener side.
• [Java Cluster] Add extension message support to AeronCluster client.
• [C++ Wrapper] Allow pass through of const uint8_t * buffers.
• [C++] Replace array with pointer to address code-ql issue on Publication in C++ API and Wrapper.
• [Build] Fix aeronmd rpath in the generated package.
• [Java Cluster] Use separate archive control session for consensus module extension.
• [Java Cluster] Add work cycle callback for ConsensusModuleExtension.
• [C/Java Driver] Replace exception with increment of counter for overflowing the retransmit pool.
• [C] add -w to C AeronStat app (#1614)
• [Java Cluster] Provide access to encoded principle for authorising consensus module extension session.
• [Java Archive] Add support for response channels startReplay and startBoundedReplay.
• [Java Samples] Fix StreamStat mapping of sub-pos which had a join position included in the channel uri and prevented it to be merged with the rest of stream positions. Also ensure that longest channel uri is printed.
• [Java Cluster] Extract ReplicationPa...

1.44.1

• [Java] Fix ClusterBackup getting stuck in the LIVE_LOG_REPLAY state.
• [Java] Validate that the egressChannel is set.
• [CI] Add Clang 18 to the build matrix.
• Upgrade to SBE 1.31.1.

1.44.0

Noteworthy Changes

• Response Channels
  • A new experimental feature that provides server/client behaviour to Aeron clients.
• Asynchronous DNS Name Resolution
  • Improve Publication/Subscription creation performance and avoid stalls by performing DNS resolution asynchronously with Aeron.
• Tethering Behaviour
  • Prevent premature disconnections by utilizing the maximum window size for tethering, even in congested networks.
• Adjust Overrun Behaviour
  • Make better use of buffers and reduce dropped consumers.
  • Enhance the performance of receivers in a max flow control use-case.
• Congestion Control Recovery
  • Significantly reduce recovery time in congested networks, without the need for any configuration changes.
• Loss Recovery Improvements
  • Reduce negative acknowledgements and message redelivery to improve the efficiency of message recovery.

Known issues

• ClusterBackup is stuck in the LIVE_LOG_REPLAY state as it trying to find recording using wrong archiveId. Fixed in 1.44.1.

Changelog

• [Java/C Driver] Support configuration flag for experimental features (#1577)
• [C Driver] Fix buffer overflow when updating counter labels.
• [Java ConsensusModule] Log cluster session failures.
• [Java/C/C++ Client/Driver] Add ability to set name on the Aeron client. (#1581)
• [Java Driver] Async DNS resolution. (#1564)
• [C Driver] async DNS resolution for the C media driver (#1566)
• [Java CluserBackup] Have cluster backup start from a specific position (#1579)
• [Java ConsensusModule] Introduce clustered service specific SnapshotDurationTracker (#1575)
• [Java Cluster] Allow setting ClusterClock via aeron.cluster.clock system property.
• [Java Driver] Call force on CnC file when doing clean shutdown and signalling ready.
• [C Driver] Add aeron_msync and use to flush CnC file contents upon start and shutdown.
• [Java Cluster/Archive] Add *MarkFile.force() method to flush any pending updates to disc and use it for signalling readiness and when closing the mark file.
• [C/Java Driver] Dissect frames and commands using key/value format.
• [C/Java Driver] Use nanosecond resolution for logging messages.
• [C Driver] Install pre-/post-interceptors logging interceptors if the incoming/outgoing chains are not NULL. Change logging order for outgoing events to log before executing command to match Java and log plain messages before encryption.
• [Java Driver] Fix FRAME_IN/FRAME_OUT event logging, i.e. allow redefinition of previously loaded classes.
• [C Driver] Scope logging functions with a "log" struct. (#1556)
• [C Driver] Add C driver logging for send_nak_message and resend (#1553)
• [C Driver] Track pending setups for cases when notified of unconnected messages. Only allow pending setups for unknown interest or existing images when in ACTIVE state. Handle unconnected streams by sending setup eliciting SMs.
• [C Driver] Fix potential leak in when adding stream interest to subscription by session.
• [Java Samples] Improve response channels samples.
• [C Driver] Align min flow control implementation with Java + allocate memory only if a receiver is added.
• [Java ConsensusModule] Use fixed 64 byte alignment that does not depend on the CACHE_LINE_LENGTH and is backwards compatible.
• [Java ConsensusModule] Fix IndexOutOfBoundsException when recording entry straddles page size.
• [Java ConsensusModule] Add leadership term id counter to ease debugging.
• [Java ConsensusModule] Add election counter.
• [Java ClusterTool] Ensure publication is connected before making cluster members query to avoid exception on checking result from ClusterTool.
• [Java] Add missing properties to the toString + print Archive/ConsensusModule/ClusteredServiceContainer configuration if aeron.print.configuration=true.
• [C/C++/Java Client] Re-assemble header for the fragmented message before calling user code.
• [Java Archive] Add Archive threading mode to the conductor duty cycle counter labels.
• [Java ClusteredServiceContainer] Trap and log snapshot exceptions while allowing cluster to resume (#1568)
• [Java ClusteredServiceContainer] Track ClusteredService lifecycle via a single field.
• [Java ConsensusModule] Remove retry logic from the ConsensusModuleProxy.
• [Java ConsensusModule] Retry sending cluster member query.
• [Java Cluster] Clarify Javadoc around clusterSessionId for offer/tryClaim methods.
• [C Samples] add locks around channel info map in response server sample app
• [Java Cluster Client] Close any partially created ingress publications and egress subscription if connect was not completed.
• [Java Client] Add Aeron#asyncRemoveSubscription.
• [Java ArchiveTool] Update Help section of Archive Tool to describe the different 'describe' commands. (#1573)
• [C++ Archive Client] Add archiveId API to the AeronArchive.
• [Java Archive Client] Use archiveId for looking up the RecordingPos counters. (#1571)
• [C++/Java Archive Client] Add getMaxRecordedPosition to AeronArchive to get the length of a recording if it is active or stopped.
• [Java/C++ Archive Client] Update Aeron Archive control protocol minor version.
• [C Driver] Align implementation of retransmit handler with Java driver.
• [Java Cluster] Set isLeader appropriately on cluster member when listing. Issue #1569
• [Java Driver] Remove unused sourceAddress from PublicationImage.
• [Java Driver] Allow the RetransmitHandler to prevent retransmissions where the term offsets don't match but NAK'd region is wholly subsumed by an existing retransmission.
• [C Driver] Per stream nak delay (#1570)
• [Java Driver] Add support for per channel configuration of nak-delay.
• [Java Driver] Add fixed loss interceptor for testing (#1551)
• [Java Driver] Suppress retransmits of the offset of the NAK is in the range of any active retransmits.
• [Java Driver] Clamp all retransmissions at the point where we create the RetransmitAction to ensure clamped length is accurately applied.
• [C/Java Driver] Change multicast NAK backoff and unicast delay linger to 10ms from 60ms.
• [C++ Wrapper Client] Prevent sanitiser errors when shutting down subscription and client in quick succession (#1549)
• [Java Archive] Validate replay completely before creating a replay Publication.
• [C Samples] add response_client/server sample apps (#1559)
• [C Driver] check for response parameters when adding destinations (#1565)
• [Java Driver] add validation when control-mode=response (#1563)
• [C Utility] Add support for PUT requests using aeron_http_util. (#1561)
• [Build] Set aeronmd rpath in the generated package. (#1557)
• Upgrade to Agrona 1.21.1.
• Upgrade to SBE 1.31.0.
• Upgrade to ByteBuddy 1.14.13.
• Upgrade to ASM 9.7.

1.41.6

• [Java/C] Allow publication image flow control under runs if they are heartbeats so a stream can be kept connected and to get a more accurate EOS when using MDS.
• [Java/C] Restrict the allowing of heartbeat under runs to only one term behind.
• [Java/C] Count under runs for heartbeats.
• [Java/C] Track EOS position per image connection for MDS.