Releases: delta-io/delta-rs
Releases · delta-io/delta-rs
rust-v0.4.0
- added primitive writer API
- added new DeltaTable method
get_file_paths_by_partitions
- added new DeltaTable method
get_active_add_actions
- added new DeltaTable method
update_incremental
- renamed
log_bytes_from_actions
tolog_entry_from_actions
- avoided clone in DeltaTable's
get_files
method - renamed camelCased fields to snake_case thanks to @nfx
- added multi-writer support for S3 backend
- optimized vacuum operation
- added checkpoint writer
- added s3-rustls feature
- added checkpoint lambda function
- made lock optional when creating s3 backend
- added missing partition component in parquet path thanks to @viirya
- started using delta statistics (row nums, null count, total bytes) in datafusion integration, thanks to @Dandandan @viirya
- avoid unnecessary object head in DeltaTable's
get_latest_version
method thanks to @viirya - fixed file content write flush in fs storage backend
python-v0.5.0
- Optimize vacuum operation
- Manage empty delta table in Python binding
- Improve Python binding development
- Add repair of failed/expired rename in S3 backend
- Fix Rename camelCased fields to snake_case
- Introduce the primitive writer API which will put a file and create the "add" action
- Add commit_version method to DeltaTransaction
- Add tests and Err restructure for commit_version
- Inline JSON action join when creating delta log entry
- Avoid commit loop call from commit_version
- Rename log_bytes_from_actions to log_entry_from_actions
- Add get_file_paths_by_partitions in Python bindings
python-v0.4.8
- Bump the version of pyarrow needed for Python bindings
- Honor AWS_REGION env var for S3 endpoint override
- Add valueContainsNull for the MapType in DeltaTable schema
- Add Vacuum command in DeltaTable
- Add "element" as the arrow list field name
- Add Date, StructArray, and Map for Pyarrow types in Python schema bindings
- Make list object streams send
python-v0.4.7
- Add createdTime in Metadata
- Update arrow dependency to 4.0.0
- Add dry_run vacuum command
- Accommodate AWS_ENDPOINT_URL in the python binding to allow alternatives to S3
- Add support for hive style partitioning when reading a table with to_pyarrow_dataset
- Allow to_pyarrow_table() to take an optional list of partitions
python-v0.4.6
- Add documentation for Python bindings
- Change the default Delta timestamp to Nanoseconds for Arrow
- Add pyarrow floatingpoint in Python bindings
- Add Metadata in Python bindings
python-v0.4.5
- Add the functionality of filtering partitions when reading a partitioned DeltaTable
- Improve the Python documentation using docstring
- Enable date column support for delta to arrow schema conversion
- Fix the struct data type generation in the Python schema method
- Add the schema when reading DeltaTable parquet files with pyarrow in Python
- Support custom endpoint URL for S3 backend
python-v0.4.4
fix glibc linking for linux build
python-v0.4.3
fix windows build
python-v0.4.2
python-v0.4.1
- fixed 2 bugs in schema handling
- fixed s3 listing bug to support open table by specific version