CHANGELOG.md

Changelog

31.0.0 (2023-01-13)

Full Changelog

Breaking changes:

• support RFC3339 style timestamps in arrow-json #3449 [arrow] (JayjeetAtGithub)
• Improve arrow flight batch splitting and naming #3444 [arrow-flight] (alamb)
• Parquet record API: timestamp as signed integer #3437 [parquet] (ByteBaker)
• Support decimal int32/64 for writer #3431 [parquet] (liukun4515)

Implemented enhancements:

• Support casting Date32 to timestamp #3504 [arrow]
• Support casting strings like '2001-01-01' to timestamp #3492 [arrow]
• CLI to "rewrite" parquet files #3476 [parquet]
• Add more dictionary value type support to build_compare #3465
• Allow concat_batches to take non owned RecordBatch #3456 [arrow]
• Release Arrow 30.0.1 (maintenance release for 30.0.0) #3455
• Add string comparisons (starts_with, ends_with, and contains) to kernel #3442 [arrow]
• make_builder Loses Timezone and Decimal Scale Information #3435 [arrow]
• Use RFC3339 style timestamps in arrow-json #3416 [arrow]
• ArrayDataget_slice_memory_size or similar #3407 [arrow] [arrow-flight]

Fixed bugs:

• Unable to read CSV with null boolean value #3521 [arrow]
• Make consistent behavior on zeros equality on floating point types #3509
• Sliced batch w/ bool column doesn't roundtrip through IPC #3496 [arrow] [arrow-flight]
• take kernel on List array introduces nulls instead of empty lists #3471 [arrow]
• Infinite Loop If Skipping More CSV Lines than Present #3469 [arrow]

Merged pull requests:

• Fix reading null booleans from CSV #3523 [arrow] (tustvold)
• minor fix: use the unified decimal type builder #3522 [parquet] (liukun4515)
• Update version to 31.0.0 and add changelog #3518 [parquet] [arrow] [arrow-flight] (iajoiner)
• Additional nullif re-export #3515 [arrow] (tustvold)
• Make consistent behavior on zeros equality on floating point types #3510 (viirya)
• Enable cast Date32 to Timestamp #3508 [arrow] (comphead)
• Update prost-build requirement from =0.11.5 to =0.11.6 #3507 [arrow-flight] (dependabot[bot])
• minor fix for the comments #3505 [arrow] (liukun4515)
• Fix DataTypeLayout for LargeList #3503 [arrow] (viirya)
• Add string comparisons (starts_with, ends_with, and contains) to kernel #3502 [arrow] (snmvaughan)
• Add a function to get memory size of array slice #3501 [arrow] (askoa)
• Fix IPCWriter for Sliced BooleanArray #3498 [arrow] (crepererum)
• Fix: Added support to cast string without time #3494 [arrow] (gaelwjl)
• Fix negative interval prettyprint #3491 [arrow] (Jefffrey)
• Fixes a broken link in the arrow lib.rs rustdoc #3487 [arrow] (AdamGS)
• Refactoring build_compare for decimal and using downcast_primitive #3484 (viirya)
• Add tests for record batch size splitting logic in FlightClient #3481 [arrow-flight] (alamb)
• change concat_batches parameter to non owned reference #3480 [arrow] (askoa)
• feat: add parquet-rewrite CLI #3477 [parquet] (crepererum)
• Preserve empty list array elements in take kernel #3473 [arrow] (jonmmease)
• Add a test for stream writer for writing sliced array #3472 [arrow] (viirya)
• Fix CSV infinite loop and improve error messages #3470 [arrow] (tustvold)
• Add more dictionary value type support to build_compare #3466 (viirya)
• Add tests for FlightClient::{list_flights, list_actions, do_action, get_schema} #3463 [arrow-flight] (alamb)
• Minor: add ticket links to failing ipc integration tests #3461 (alamb)
• feat: column_name based index access for RecordBatch and StructArray #3458 [arrow] (askoa)
• Support Decimal256 in FFI #3453 [arrow] (viirya)
• Remove multiversion dependency #3452 [arrow] (tustvold)
• Re-export nullif kernel #3451 [arrow] (tustvold)
• Meaningful error message for map builder with null keys #3450 [arrow] (Jefffrey)
• Parquet writer v2: clear buffer after page flush #3447 [parquet] (askoa)
• Verify ArrayData::data_type compatible in PrimitiveArray::from #3440 [arrow] (tustvold)
• Preserve DataType metadata in make_builder #3438 [arrow] (tustvold)
• Consolidate arrow ipc tests and increase coverage #3427 [arrow] (alamb)
• Generic bytes dictionary builder #3426 [arrow] (viirya)
• Minor: Improve docs for arrow-ipc, remove clippy ignore #3421 [arrow] (alamb)
• refactor: convert *like_dyn, *like_utf8_scalar_dyn and *like_dict functions to macros #3411 [arrow] (askoa)
• Add parquet-index binary #3405 [parquet] (tustvold)
• Complete mid-level FlightClient #3402 [arrow-flight] (alamb)
• Implement RecordBatch <--> FlightData encode/decode + tests #3391 [arrow] [arrow-flight] (alamb)
• Provide into_builder for bytearray #3326 [arrow] (viirya)

* This Changelog was automatically generated by github_changelog_generator