LoginSign Up
← Back to all sparks
A

Apache Arrow Rust

DEVOPS
Velocity5.0

Rust implementation of the Apache Arrow columnar in-memory format

arrow.apache.org/rust ↗

Arrow Rust 60.1.0 ships, redacting Parquet encryption keys and adding read-ahead planning.

apache arrowrustparquetmemory safetybackports
◆Current state
Arrow Rust published 60.1.0 on Oct 28, the first minor on the 60 line. It redacts Parquet encryption keys from Debug output and adds a scan_plan for read-ahead in the Parquet push decoder, a separate page-index decoder, per-column page row limits, interleaved batch coalescing and new ArrayReader/ArrayIterator concepts. Two days earlier 59.3.2 and 58.4.1 shipped with a use-after-free fix in Buffer::shrink_to_fit and other correctness backports, and 57.3.2 is also out.
◆Where it's heading
The project ships new Parquet decoding APIs on the current major while pushing memory-safety and data-correctness fixes to three older lines, which suggests downstream engines pin old majors for long periods. The Parquet work keeps aiming at async, push-based reading with finer control over I/O.
◆Prediction
Expect 61.0.0 on the usual major cadence, with more push-decoder and page-index APIs, while 59.x and 58.x get further backports.

◆Recent moves

  1. 1d ago

    Arrow 60.1.0: Parquet key redaction and read-ahead planning

    The first 60.x minor combines a security fix that keeps Parquet encryption keys out of Debug output with a batch of push-decoder APIs, including read-ahead scan planning and a standalone page-index decoder. It builds on the page-index APIs that 60.0.0 stabilized.

    View source ↗
  2. 3d ago

    arrow 58.4.1

    The 58.x line gets the same correctness batch as 59.x, including the shrink_to_fit use-after-free and run-array offset fixes. Users on older majors aren't left with known memory bugs.

    View source ↗
  3. 3d ago

    arrow 59.3.2

    The second 59.x patch in two weeks fixes a use-after-free, run-array offsets, union validation and Parquet miniblock decoding. It continues the silent-data-bug cleanup 59.3.1 started.

    View source ↗
  4. 5d ago

    Arrow Rust 60.1.0 release candidate

    The release candidate for 60.1.0, the first minor on the 60 line. The tag is just the version bump and changelog.

    View source ↗
  5. 6d ago

    Arrow Rust 59.3.2 release candidate

    The RC tag for 59.3.2, with a hand-written changelog because backport PRs lacked labels.

    View source ↗
  6. 6d ago

    Arrow Rust 58.4.1 release candidate

    The 58.4.1 RC tag, syncing release instructions from main. Process only.

    View source ↗