Apache IoTDB 1.3.3

Features & Improvements

• Storage Engine: Added new data types String, Blob, Date, and Timestamp.
• Storage Engine: Multi-level storage has added a rate-limiting mechanism.
• Storage Engine: New merge target file splitting feature, with additional configuration file parameters, and improved memory control performance of the merge module.
• Data Query: Filter performance optimization, enhancing the speed of aggregate queries and where condition queries.
• Data Query: New client query requests load balancing optimization.
• Data Query: New active metadata statistics query added.
• Data Query: Optimized memory control strategy during the query planning phase.
• Data Synchronization: The sender supports transferring files to a specified directory, and the receiver automatically loads them into IoTDB.
• Data Synchronization: The receiver has a new automatic conversion mechanism for data type requests.
• Data Synchronization: Enhanced observability on the receiver side, supporting ops/latency statistics for multiple internal interfaces, consolidated into a single pipeTransfer display.
• Data Loading: DataNode actively listens and loads TsFiles, with additional observability metrics.
• Stream Processing Module: New data subscription capability, supporting subscription to database data in the form of data points or tsfile files.
• Stream Processing Module: Alter Pipe supports the ability to alter the source.
• System Management: Optimized configuration files, with the original three configuration files merged into one, reducing user operational costs.
• System Management: Optimized restart recovery performance, reducing startup time.
• System Management: Internal addition of monitoring items such as device count, estimated remaining time for data synchronization, size of data to be synchronized, and synchronization speed.
• Scripts and Tools: The import-tsfile script is expanded to support running the script on a different server from the IoTDB server.
• Scripts and Tools: New metadata import and export scripts added.
• Scripts and Tools: New support for Kubernetes Helm added.
• AINode: AINode module added.
  ...

Bugs

• Fixed the issue of NullPointerException (NPE) when merging chunks with modifications and empty pages in the sequential space.
• Fixed the issue where the wrong parent file was used when reassigning the file position for skipped files during merge, leading to failure in creating hard links.
• Fixed the issue where the newly added four data types had null values written, and the TsFile handling of the STRING type was incorrect, causing a BufferUnderflowException: null.
• Fixed the issue in the high availability scenario where stopping the DataNode resulted in a PipeException: Failed to start consensus pipe.
• Fixed the issue in Stream mode where the first batch of written data points might require a flush to be synchronized.
• Fixed the compatibility issue with pipe plugin upgrades.
• Fixed the issue where the ORDER BY clause became ineffective when used in combination with LIMIT in the last query.
  ...

New Contributors

• @alxkhi made their first contribution in #12296
• @SihanLiu2024 made their first contribution in #12323
• @supersshhhh made their first contribution in #12512
• @bdemers made their first contribution in #12971

Full Changelog: v1.3.2...v1.3.3

Apache IoTDB 1.3.2

Features & Improvements

• Storage Module: Performance improvement in the insertRecords interface for writing
• Query Module: New Explain Analyze statement added (monitoring the time spent on each stage of a single SQL execution)
• Query Module: New UDAF (User-Defined Aggregate Function) framework added
• Query Module: New MaxBy/MinBy functions added, supporting the retrieval of maximum/minimum values along with the corresponding timestamps
• Query Module: Performance improvement in value filtering queries
• Data Synchronization: Path matching supports path pattern
• Data Synchronization: Supports metadata synchronization (including time series and related attributes, permissions, etc.)
• Stream Processing: Added Alter Pipe statement, supporting hot updates of plugins for Pipe tasks
• System Module: System data point count statistics now include statistics for data imported by loading TsFile
• Scripts and Tools: New local upgrade backup tool added (backing up original data through hard links)
• Scripts and Tools: New export-data/import-data scripts added, supporting data export in CSV, TsFile formats or SQL statements
• Scripts and Tools: Windows environment now supports distinguishing ConfigNode, DataNode, and Cli by window name
  ...

Bugs

• Optimize the error message when a NullPointerException (NPE) occurs due to a timeout when dropping a database.
• Add logs for notifyLeaderReady, notifyLeaderChanged, and procedure worker.
• Add compatibility handling for existing erroneous data during file merging.
• Fix the deadlock issue caused by flushing empty files during querying.
• Fix the issue where Ratis becomes unresponsive during read, write, and delete operations.
• Fix the concurrent bug in load and merge operations.
• Fix the issue where the system's compression ratio is recorded as a negative number in the file for certain scenarios.
• Fix the ConcurrentModificationException issue during memory estimation for merge tasks.
• Fix potential deadlocks that may occur when writing, automatically creating, and deleting databases concurrently.
  ...

What's Changed

• Delete write mem control parameters by @l2280212 in #12007
• Pipe: Ensure at-least-once semantic by forcibly starting PipeHistoricalDataRegionTsFileExtractor after pipe restart by @Caideyipi in #12010
• Separate the synchronized block of AbstractCompactionEstimator file info cache by @shuwenwei in #12019
• Pipe: using clusterId to judge whether the target cluster is source cluster by @xuanronaldo in #11994
• Storage Engine: fix wal delete thread exception because multi thread safety question by @caozj1011 in #12020
• PBTree: Fix Dead Lock and Refactor write/update inteface by @bigreybear in #11985
• Remove sql merge by @shuwenwei in #12021
• Load: Trigger last flush time map & tsfile resource degrading after successful load by @SteveYurongSu in #12024
• feat(jdbc):getDouble add type check by @CritasWang in #12023
• Remove infinite retry logic for replica inconsistency to avoid potential problems by @OneSizeFitsQuorum in #12028
• Pipe: Support "sink.host" and "connector.host" key in receiver IP specification by @Caideyipi in #12017
• Fixed Ratis query not retrying when DataNode restarts by @OneSizeFitsQuorum in #12029
• Pipe: support replace and modify mode for alter pipe sql by @VGalaxies in #12018
• Storage Engine: put DeviceCache into the total memory of the storage engine by @caozj1011 in #12016
• Bump jackson.version from 2.15.2 to 2.15.3 by @dependabot in #12014
• IT framework supports restarting cluster by @l2280212 in #12022
• Fix typo for parameter dn_multi_dir_strategy by @OneSizeFitsQuorum in #12033
• Upgrade github action version to fix the warning by @HTHou in #12032
• Introduce UDAF(User-Defined Aggregation Functions) by @Sh-Zh-7 in #12005
• Pipe: Move parsing event logic into PipeProcessorSubtask to separate CPU intensive and IO intensive tasks by @DanielWang2035 in #11965
• DataNodeDevicePathCache should use free memory of memtable by @HTHou in #12034
• Pipe: Revert "Pipe: stop pipe using restarting strategy to unpin the wal's reference count to avoid WAL stacking (#11971)" to avoid unnecessary pipe drop during subtask exception handling by @Caideyipi in #12031
• Pipe: Removed mayLinkedTsFileCountReachDangerousThreshold judgement from stuck restart logic by @Caideyipi in #12041
• Pipe: fixed the bug that processor dies when encountered memory shortage for tablets in a period of time by @Caideyipi in #12042
• Pipe: Reduced pipe logs and controlled how often the log is printed below a certain frequency by @Caideyipi in #11973
• [IOTDB-6296] Fix memory leak in MQTTService by @JackieTien97 in #12046
• Pipe: Pattern parsing pruning: When pattern is at the level below database, the parsing logic can be skipped if tsfiles / tablets completely match with the pattern by @Caideyipi in #12049
• Bump org.apache.commons:commons-compress from 1.21 to 1.26.0 by @dependabot in #12058
• Bump ip from 2.0.0 to 2.0.1 in /iotdb-connector/grafana-plugin by @dependabot in #12057
• Pipe: fixed potential lose point bug caused by cancelled flush of historical extractor by @Caideyipi in #12056
• Fix it which use 'merge' command by @shuwenwei in #12060
• Pipe: Fixed the bug that CN cannot sense drop pipe failure in meta sync and may lead to constantly skip of drop pipe by @Caideyipi in #12059
• [IOTDB-6297] Optimize the distribute plan in the situation of aggregation with align by device by @Beyyes in #12043
• [IOTDB-6298] Fix number overflow in group by time interval by @JackieTien97 in #12065
• [IOTDB-6299] Fix bug in merging overlapped data process caused by filter & offset push down by @liuminghui233 in #12068
• Introduce Aggregation Function MinBy by @lancelly in #12071
• Add recover IT for Procedure, and delete ProcedureStore by @liyuheng55555 in #12045
• PBTree: Implement dual-buffer container for MNode management by @linxt20 in #12048
• Optimize flushing memtable check by @HTHou in #12081
• [IOTDB-6302] Enhance the support of ISO_LOCAL_DATE_TIME timestamp format by @HTHou in #12086
• IT: revert some changes in restart IT to make the error log clear when failed to restart by @l2280212 in #12066
• change ci to github ci by @CritasWang in #12073
• feat(bat): add title and set format by @CritasWang in #12069
• Fix dead lock in PBTree.SchemaFile by @bigreybear in #12079
• fix.root privileges lost and grant role. by @ColinLeeo in #12091
• [IOTDB-6300] Support place time column at any column index in insert statement by @JackieTien97 in #12074
• Make Drop database timeout return message more detailed by @Cpaulyz in #12082
• Fix VolatileSubtreeIterator missing update buffer if all nodes in new buffer are not qualified by @Cpaulyz in #12093
• Pbtree: MNode iterating with merge sort upon disk and buffer by @linxt20 in #12077
• Add FileUtils.moveFileSafe function by @liyuheng55555 in #12094
• Add logs for data partition allocation by @CRZbulabula in #12090
• fix: IoTDBPreparedStatement implement addBatch function by @CritasWang in #12095
• [IOTDB-6303] Correct the default path of user, role and procedure folder by @CRZbulabula in #12089
• Cache clusterId in IoTDBConfig by @liyuheng55555 in #12053
• Implement new plan optimizer: PredicatePushDown by @liuminghui233 in #11859
• Optimize ConfigNode ConsensusManager init logic by @OneSizeFitsQuorum in #12098
• Do not wait to retry when configLeader exists by @Pengzna in #12075
• Faster repair data by @shuwenwei in #12039
• Bump org.scala-lang:scala-library from 2.12.18 to 2.12.19 by @dependabot in #12104
• Bump flink.version from 1.17.0 to 1.17.2 by @dependabot in #12103
• [IOTDB-6305] Add show current_timestamp statement by @yx-zhang in #12106
• [IOTDB-6306] Fix t...

Apache IoTDB 1.3.1

Features & Improvements

• Add cluster script for one-click start-stop (start-all/stop-all.sh & start-all/stop-all.bat)
• Add script for one-click instance information collection (collect-info.sh & collect-info.bat)
• Add new statistical aggregators include stddev and variance
• Add repair tsfile data command
• Support setting timeout threshold for Fill clause. When time beyond the threshold, do not fill value.
• Simplify the time range specification for data synchronization, directly set start and end times
• Improved system observability (adding dispersion monitoring of cluster nodes, observability of distributed task scheduling framework)
• Optimized default log output strategy
• Enhance memory control for Load TsFile, covering the entire process
• Rest API (Version 2) adds column type return.
• Improve the process of query execution
• Session automatically fetch all available DataNodes
  ...

Bugs

• Fix issue with abnormal behavior when time precision is not in milliseconds during grouping by month.
• Fix issue with abnormal behavior when duration contains multiple units during grouping by month.
• Fix bug where limit and offset cannot be pushed down when there is an order by clause.
• Fix abnormal behavior in combination scenario of grouping by month + align by device + limit.
• Fix deserialization errors during IoT protocol synchronization.
• Fix concurrent exceptions in deleting timeseries.
• Fix issue where group by level in view sequences does not execute correctly.
• Fix potential issue of metadata creation failure when increasing election timeout

New Contributors

• @Jgj1006 made their first contribution in #11730

Full Changelog: v1.3.0...v1.3.1

Apache IoTDB 1.3.0

Features & Improvements

• Optimize the permission module and support timeseries permission control
• Optimize heap and off-heap memory configuration in startup script
• Computed-type view timeseries support LAST queries
• Add pipe-related monitoring metrics
• Pipe rename 'Extractor' to 'Source' and 'Connector' to 'Sink'
• [IOTDB-6138] Support Negative timestamp
• [IOTDB-6193] Reject Node startup when loading configuration file failed
• [IOTDB-6194] Rename target_config_node_list to seed_config_node
• [IOTDB-6200] Change schema template to device template
• [IOTDB-6207] Add Write Point Metrics for load function
• [IOTDB-6208] Node error detection through broken thrift pipe
• [IOTDB-6217] When the number of time series reaches the upper limit, the prompt message should be changed to prioritize using device templates
• [IOTDB-6218] Rename storage_query_schema_consensus_free_memory_proportion to datanode_memory_proportion
• [IOTDB-6219] Fix the display problem of explain that the print result is not aligned
• [IOTDB-6220] Pipe: Add check logic to avoid self-transmission
• [IOTDB-6222] Optimize the performance of Python client
• [IOTDB-6230] Add HEAPDUMP configuration in datanode-env.sh
• [IOTDB-6231]SchemaCache supports precise eviction
• [IOTDB-6232] Adding SSL function to dn_rpc_port

Bugs

• [IOTDB-6160] while using ` in target path, select into will throw error
• [IOTDB-6167] DataNode can't register to cluster when fetch system configuration throws NPE
• [IOTDB-6168] ConfigNode register retry logic does not worked
• [IOTDB-6171] NPE will be thrown while printing FI with debug on
• [IOTDB-6184] Merge Sort finishes one iterator too long
• [IOTDB-6191] Fix group by year not considering leap years
• [IOTDB-6226] Fix the problem of inaccurate GC monitor detection at the beginning and adjusting the alert threshold
• [IOTDB-6239] Show regions display error create time

New Contributors

• @clayburn made their first contribution in #11243
• @chunshao90 made their first contribution in #11385

Full Changelog: v1.2.2...v1.3.0

Apache IoTDB 1.2.2

Features & Improvements

• [IOTDB-6029] Implementing flink-sql-iotdb-connector
• [IOTDB-6084] Pipe: support node-urls in connector-v1
• [IOTDB-6103] Adding count_time aggregation feature
• [IOTDB-6112] Limit & Offset push down doesn't take effect while there exist time filter
• [IOTDB-6115] Limit & Offset push down doesn't take effect while there exist null value
• [IOTDB-6120] push down limit/offset in query with group by time
• [IOTDB-6129] ConfigNode restarts without relying on Seed-ConfigNode
• [IOTDB-6131] Iotdb rest service supports insertRecords function
• [IOTDB-6151] Move DataNode's system.properties to upper dir
• [IOTDB-6173] Change default encoder of INT32 and INT64 from RLE to TS_2DIFF
• Adjust the default thrift timeout parameter to 60s
• Accelerate the deletion execution

Bugs

• [IOTDB-6064] Pipe: Fix deadlock in rolling back procedures concurrently
• [IOTDB-6081] Pipe: use HybridExtractor instead of LogExtractor when realtime mode is set to log to avoid OOM under heavy insertion load
• [IOTDB-6145] Pipe: can not release TsFile or WAL resource after pipe is dropped
• [IOTDB-6146] Pipe: can not transfer data after 1000+ pipes' creating and dropping
• [IOTDB-6082] Improve disk space metrics
• [IOTDB-6104] tmp directory won't be cleaned after udf query end
• [IOTDB-6119] Add ConfigNode leader service check
• [IOTDB-6125] Fix DataPartition allocation bug when insert big batch data
• [IOTDB-6127] Pipe: buffered events in processor stage can not be consumed by connector
• [IOTDB-6132] CrossSpaceCompaction: The estimated memory size is too large for cross space compaction task
• [IOTDB-6133] NullPointerException occurs in unsequence InnerSpaceCompactionTask
• [IOTDB-6148] Pipe: Fixed the bug that some uncommited progresses may be reported
• [IOTDB-6156] Fixed TConfiguration invalidly in Thrift AsyncServer For IoTConsensus
• [IOTDB-6164] Can create illegal path through rest api
• Fix datanode status is ReadOnly because the disk is full
• Fix DataPartition allocation bug when insert big batch
• Fix flush point statistics
• Fix SchemaFileSketchTool is not found
• Refactoring DeleteOutdatedFileTask in WalNode
• Add compression and encoding type check for FastCompactionPerformer
• Add lazy page reader for aligned page reader to avoid huge memory cost when reading rows of aligned timeseries
• Pipe: use PipeTaskCoordinatorLock instead of ReentrantLock for multi thread sync
• Pipe: fix pipe procedure stuck because of data node async request forever waiting for response
• Pipe: fix NPE when HybridProgressIndex.updateToMinimumIsAfterProgressIndex after system reboot (DR: SimpleConsensus)
• Pipe: fix pipe coordinator deadlock causing CN election timeout
• Pipe: Improve performance for 10000+ pipes
• RATIS-1873. Remove RetryCache assertion that doesn't hold

Full Changelog: v1.2.1...v1.2.2

Apache IoTDB 1.2.1

Features & Improvements

• [IOTDB-5557] The metadata query results are inconsistent
• [IOTDB-5997] Improve efficiency of ConfigNode PartitionInfo loadSnapshot
• [IOTDB-6019] Fix concurrent update of last query
• [IOTDB-6036] The mods file is too large, causing Query very slow even OOM problem
• [IOTDB-6055] Enable auto restart of the pipes stopped by ConfigNode because of critical exception
• [IOTDB-6066] Add ConfigNode timeslot metric
• [IOTDB-6073] Add ClientManager metrics
• [IOTDB-6077] Add force stop
• [IOTDB-6079] Cluster computing resource balance
• [IOTDB-6082] Improve disk space metrics
• [IOTDB-6087] Implement stream interface of Mods read
• [IOTDB-6090] Add memory estimator on inner space compaction
• [IOTDB-6092] Factor mods files into memory estimates for cross-space compaction tasks
• [IOTDB-6093] Add multiple validation methods after compaction
• [IOTDB-6106] Fixed the timeout parameter not working in thrift asyncClient
• [IOTDB-6108] AlignedTVList memory calculation is imprecise

Bugs

• [IOTDB-5855] DataRegion leader Distribution is same as DataRegion Distribution
• [IOTDB-5860] Total Number of file is wrong
• [IOTDB-5996] Incorrect time display of show queries
• [IOTDB-6057] Resolve the compatibility from 1.1.x to 1.2.0
• [IOTDB-6065] Considering LastCacheContainer in the memory estimation of SchemaCacheEntry
• [IOTDB-6074] Ignore error message when TagManager createSnapshot
• [IOTDB-6075] Pipe: File resource races when different tsfile load operations concurrently modify the same tsfile at receiver
• [IOTDB-6076] Add duplicate checking when upsert alias
• [IOTDB-6078] fix timeChunk default compressType
• [IOTDB-6089] Improve the lock behaviour of the pipe heartbeat
• [IOTDB-6091] Add compression and encoding type check for FastCompactionPerformer
• [IOTDB-6094] Load：Fix construct tsFileResource bug
• [IOTDB-6095] Tsfiles in sequence space may be overlap with each other due to LastFlushTime bug
• [IOTDB-6096] M4 will output zero while meeting null
• [IOTDB-6097] ipe subscription running with the pattern option may cause OOM
• [IOTDB-6098] Flush error when writing aligned timeseries
• [IOTDB-6100] Pipe: Fix running in hybrid mode will cause wal cannot be deleted & some pipe data lost due to wrong ProducerType of Disruptor
• [IOTDB-6105] Load: NPE when analyzing tsfile

New Contributors

• @Zhangchaoming made their first contribution in #10152
• @qiuyluo made their first contribution in #10422

Full Changelog: v1.2.0...v1.2.1

Apache IoTDB 1.2.0

New Feature

• [IOTDB-5567] add SQL for querying seriesslotid and timeslotid
• [IOTDB-5631] Add a built-in aggregation functions named time_duration
• [IOTDB-5636] Add round as built-in scalar function
• [IOTDB-5637] Add substr as built-in scalar function
• [IOTDB-5638] Support case when syntax in IoTDB
• [IOTDB-5643] Add REPLACE as a built-in scalar function
• [IOTDB-5683] Support aggregation function Mode for query
• [IOTDB-5711] Python API should support connecting multiple nodes
• [IOTDB-5752] Python Client supports write redirection
• [IOTDB-5765] Support Order By Expression
• [IOTDB-5771] add SPRINTZ and RLBE encodor and LZMA2 compressor
• [IOTDB-5924] Add SessionPool deletion API
• [IOTDB-5950] Support Dynamic Schema Template
• [IOTDB-5951] Support show timeseries/device with specific string contained in path
• [IOTDB-5955] Support create timeseries using schema template in Session API

Improvements

• [IOTDB-5630] Make function cast a built-in function
• [IOTDB-5689] Close Isink when ISourceHandle is closed
• [IOTDB-5715] Improve the performance of query order by time desc
• [IOTDB-5763] Optimize the memory estimate for INTO operations
• [IOTDB-5887] Optimize the construction performance of PathPatternTree without wildcards
• [IOTDB-5888] TTL logs didn' t consider timestamp precision
• [IOTDB-5896] Failed to execute delete statement
• [IOTDB-5908] Add more query metrics
• [IOTDB-5911] print-iotdb-data-dir tool cannot work
• [IOTDB-5914] Remove redundant debug log in Session
• [IOTDB-5919] show variables add a variable timestamp_precision
• [IOTDB-5926] Optimize metric implementation
• [IOTDB-5929] Enable DataPartition inherit policy
• [IOTDB-5943] Avoid rpc invoking for SimpleQueryTerminator when endpoint is local address
• [IOTDB-5944] Follower doesn' t need to update last cache when using IoT_consensus
• [IOTDB-5945] Add a cache to avoid initialize duplicated device id object in write process
• [IOTDB-5946] Optimize the implement of tablet in Go client
• [IOTDB-5949] Support show timeseries with datatype filter
• [IOTDB-5952] Support FIFO strategy in DataNodeSchemaCache
• [IOTDB-6022] The WAL piles up when multi-replica iotconsensus is written at high concurrency

Bug Fixes

• [IOTDB-5604] NPE when execute Agg + align by device query without assigned DataRegion
• [IOTDB-5619] group by tags query NPE
• [IOTDB-5644] Unexpected result when there are no select expressions after analyzed in query
• [IOTDB-5657] Limit does not take effect in last query
• [IOTDB-5700] UDF query did not clean temp file after the query is finished
• [IOTDB-5716] Wrong dependency when pipeline consumeOneByOneOperator
• [IOTDB-5717] Incorrect result when querying with limit push-downing & order by time desc
• [IOTDB-5722] Wrong default execution branch in PlanVisitor
• [IOTDB-5735] The result of adding the distinct function to the align by device is incorrect
• [IOTDB-5755] Fix the problem that 123w can not be used in Identifier
• [IOTDB-5756] NPE when where predicate is NotEqualExpression and one of subExpression is not exist
• [IOTDB-5757] Not Supported Exception when use like ' s3 || false' in where even Type of s3 is Boolean
• [IOTDB-5760] Query is blocked because of no memory
• [IOTDB-5764] Cannot specify alias successfully when the FROM clause contains multiple path suffixes
• [IOTDB-5769] Offset doesn' t take effect in some special case
• [IOTDB-5774] The syntax that path nodes start or end with a wildcard to fuzzy match is not supported
• [IOTDB-5784] Incorrect result when querying with offset push-down and time filter
• [IOTDB-5815] NPE when using UDF to query
• [IOTDB-5837] Exceptions for select into using placeholders
• [IOTDB-5851] Using limit clause in show devices query will throw NPE
• [IOTDB-5858] Metric doesn' t display the schemaCache hit ratio
• [IOTDB-5861] Last quey is incomplete
• [IOTDB-5889] TTL Cannot delete expired tsfiles
• [IOTDB-5897] NullPointerException In compaction
• [IOTDB-5905] Some aligned timeseries data point lost after flush
• [IOTDB-5934] Optimize cluster partition policy
• [IOTDB-5953] LastCache memory control param does not take effect
• [IOTDB-5963] Sometimes we may get out-of-order query result
• [IOTDB-6016] Release file num cost after cross compaction task

New Contributors

• @EliasMei made their first contribution in #9291
• @nikam14 made their first contribution in #9368
• @riverbuilding made their first contribution in #9379
• @lichenyu20 made their first contribution in #9458

Full Changelog: v1.1.2...v1.2.0

Apache IoTDB 1.1.2

New Feature

• [IOTDB-5919]show variables add a variable timestamp_precision
• Add Python SessionPool

Improvement/Bugfix

• [IOTDB-5901] Load: load tsfile without data will throw NPE
• [IOTDB-5903] Fix cannot select any inner space compaction task when there is only unsequence data
• [IOTDB-5878] Allow ratis-client retry when gRPC IO Unavailable
• [IOTDB-5939] Correct Flusing Task Timeout Detect Thread
• [IOTDB-5905] Fix aligned timeseries data point lost after flushed in some scenario
• [IOTDB-5963] Make sure that TsBlock blocked on memory is added in queue before the next TsBlock returned by root operator
• [IOTDB-5819] Fix npe when booting net metrics
• [IOTDB-6023] Pipe: Fix load tsfile error while handling empty value chunk
• [IOTDB-5971] Fix potential QUOTE problem in iotdb reporter
• [IOTDB-5993] ConfigNode leader changing causes lacking some DataPartition allocation result in the response of getOrCreateDataPartition method
• [IOTDB-5910] Fix compaction scheduler thread pool is not shutdown when aborting compaction
• [IOTDB-6056] Pipe: Failed to load tsfile with empty pages (NPE occurs when loading)
• [IOTDB-5916]Fix exception when file is deleted during compaction selection
• [IOTDB-5896] Fix the NPE issue when taking snapshot in WAL combined with Aligned Binary
• [IOTDB-5929] Enable DataPartition inherit policy
• [IOTDB-5934] Optimize cluster partition policy
• [IOTDB-5926] Remove Useless Rater in Timer
• [IOTDB-6030] Improve efficiency of ConfigNode PartitionInfo takeSnapshot
• [IOTDB-5997] Improve efficiency of ConfigNode PartitionInfo loadSnapshot
• Fix potential deadlock when freeing memory in MemoryPool
• Release resource of FI after all drivers have been closed
• Set default degree of parallelism back to the num of CPU
• Make SequenceStrategy and MaxDiskUsableSpaceFirstStrategy are allowed in cluster mode
• Fix npe exception when invalid in metric module
• Fix CQ does not take effect in ns time_precision
• Fix storage engine memory config initialization
• Fix template related schema query
• add default charset setting in start-datanode.bat and print default charset when starting
• Fix TsfileResource error after delete device in sequence working memtable
• load TsFile bugs: Not checking whether the tsfile data loaded locally is in the same time partition during the loading process & LoadTsFilePieceNode error when loading tsfile with empty value chunks
• Fix alias query failure after restarting DataNode

Apache IoTDB 1.1.1

New Feature

• [IOTDB-2569] ZSTD compression

Improvement/Bugfix

• [IOTDB-5781] Change the default strategy to SequenceStrategy
• [IOTDB-5780] Let users know a node was successfully removed and data is recovered
• [IOTDB-5735] The result of adding the distinct function to the align by device is incorrect
• [IOTDB-5777] When writing data using non-root users, the permission authentication module takes too long
• [IOTDB-5835] Fix wal accumulation caused by datanode restart
• [IOTDB-5828] Optimize the implementation of some metric items in the metric module to prevent Prometheus pull timeouts
• [IOTDB-5813] ConfigNode restart error due to installSnapshot failed
• [IOTDB-5657] Limit does not take effect in last query
• [IOTDB-5717] Incorrect result when querying with limit push-downing & order by time desc
• [IOTDB-5722] Wrong default execution branch in PlanVisitor
• [IOTDB-5784] Incorrect result when querying with offset push-down and time filter
• [IOTDB-5815] NPE when using UDF to query
• [IOTDB-5829] Query with limit clause will cause other concurrent query break down
• [IOTDB-5824] show devices with * cannot display satisfied devices
• [IOTDB-5831] Drop database won't delete totally files in disk
• [IOTDB-5818] Cross_space compaction of Aligned timeseries is stucked
• [IOTDB-5859] Compaction error when using Version as first sort dimension
• [IOTDB-5869] Fix load overlap sequence TsFile

Apache IoTDB 1.1.0

New Features

• [IOTDB-4572] support order by time in align by device
• [IOTDB-4816] Support Show Queries command
• [IOTDB-4817] Support kill query command
• [IOTDB-5077] Support new command formats in SHOW REGIONS
• [IOTDB-5108] Support region migration
• [IOTDB-5202] Support show regions with specific database
• [IOTDB-5282] Add SQL show variables, which can display the current cluster variables
• [IOTDB-5341] Support GROUP BY VARIATION in aggregation query
• [IOTDB-5372] Support data type cast in SELECT INTO
• [IOTDB-5382] Support DIFF as built-in scalar function in IoTDB
• [IOTDB-5393] Show Region creation time when execute show regions
• [IOTDB-5456] Implement COUNT_IF built-in aggregation function
• [IOTDB-5515] Support GROUP BY CONDITION in aggregation query
• [IOTDB-5555] Enable modify dn_rpc_port and dn_rpc_address in datanode-engine.properties
• Support docker deployment
• Rename SeriesSlotId to SeriesSlotNum in show regions

Improvements

• [IOTDB-4497] Improve NodeStatus definition
• [IOTDB-5066] Upgraded the GetSlots SQLs
• [IOTDB-5161] Add output type check for WHERE & HAVING clause and refuse expressions whose return type are not boolean exist in WHERE & HAVING clause
• [IOTDB-5185] Fixed that old snapshot is not deleted in IoTConsensus
• [IOTDB-5287] Added status “Discouraged” to RegionGroup
• [IOTDB-5449] Wait for query resource while the query queue is full instead of throwing exception directly
• change STARTUP_RETRY_INTERVAL_IN_MS from 30s to 3s

Bug Fixes

• [IOTDB-4684] Fix devices with the same name but different alignment properties are compacted into the wrong alignment property
• [IOTDB-5061] Add initialize state check when create snapshot
• [IOTDB-5090] Fix the NPE when executing stop-datanode.sh
• [IOTDB-5112] Fixed IoTConsensus synchronization stuck under low load or during restart
• [IOTDB-5126] Fix that show-regions show IP rather than hostname even though the hostname is used when registering
• [IOTDB-5165] Fix fail to pass compaction validation when resources degrade to FileTimeIndex
• [IOTDB-5170] Fix the problem that datanode is closed when executing stop-confignode.bat on Windows platform
• [IOTDB-5199] Fix NPE in StorageExector inLoading process
• [IOTDB-5216] Fix order by timeseries doesn't take effect in aligned last query
• [IOTDB-5228] NPE if the file does not exist while creating TsFileSequenceReader instance
• [IOTDB-5240] Fix schema template timeseries read/write error after restart
• [IOTDB-5245] Fix data is incomplete in last query
• [IOTDB-5277] Fix DataNode restart failure when SchemaRegion loading snapshot
• [IOTDB-5278] Fix JDBC Driver cannot connect to the dbeaver
• [IOTDB-5285] Fix TimePartition error when restarting with different time partition configuration
• [IOTDB-5269] Fix wrong data of devices ought to be deleted after executing delete from sql
• [IOTDB-5324] Fix wal cann't be deleted in destDataNode after region migration when data_replication_factor is 1 in IoTConsensus
• [IOTDB-5389] Cause DataNode startup to fail when wal_mode is disabled in IoTConsensus
• [IOTDB-5414] Fix timeseries with alias deleted success but can still be queried by alias
• [IOTDB-5426] Cannot trigger flush for sequence file when timed flush enabled
• [IOTDB-5441] Fix NPE while fetch schema that is not in template used by related device
• [IOTDB-5469] Fix get schema info failure after creating template with backquote characters successfully
• [IOTDB-5474] Fix count nodes using level bug
• [IOTDB-5480] IoTConsensus sync lag may be negative under single copy
• [IOTDB-5488] Support set system to readonly on local
• [IOTDB-5492] Skip broken tsfile when recovering system
• [IOTDB-5512] Fixed IoTConsensus may repeatedly send some log when restarting
• [IOTDB-5516] Fix creating timeseries failure after dropping all databases
• [IOTDB-5526] Fix deleting timeseries failure when it belongs to a device activating template
• [IOTDB-5548] Fix dropping template failure when using pure number as template name
• [IOTDB-5592] Fix unexpected error while using full path(starting with root) in having/where clause
• [IOTDB-5620] Fix flush stuck when there is a lot of time partitions in each DataRegion
• [IOTDB-5639] Fix file not found exception in cross space compaction selector
• [IOTDB-5657] Fix LIMIT&OFFSET does not take effect in last query
• [IOTDB-5684] Fix log folder generation when using ConfigNode's Simple consensus protocol
• [IOTDB-5685] Fix error msg of failing to create a timeseries on an existing path when ReadOnly state
• [IOTDB-5686] Fix devices with the same name but different alignment properties meets error in inner seq compaction
• [IOTDB-5700] Clean temporary files created by UDF query after it finishes
• Add SHOW_CQ privilege