feat: lakefs integration

[ion-elgreco]

Description

Makes LakeFS first-class citizen in delta-rs. Operations are executed in a transaction branch, where we write into and then try to commit and merge if there is no conflict. If there is a conflict it means there was a concurrent writer, so we remove the log, and retry with the conflict checker.

Main concepts that this PR introduces through out the core crate:

• LogStore makes distinction between reading and writing objectstore, the writing store can receive an optional operation_id
• Every operation has customExecuteHandler which implements a pre_execute and post_execute.
  • pre-execute is executed usually right away, or after sanity checks are done in the operation
  • post-execute is executed after commitbuilder has finished
• CommitBuilder also uses operation_id to pass it to commit_entry functions

[github-actions]

ACTION NEEDED

delta-rs follows the Conventional Commits specification for release automation.

The PR title and description are used as the merge commit message. Please update your PR title and description to match the specification.

[codecov]

Codecov Report

Attention: Patch coverage is 27.40964% with 964 lines in your changes missing coverage. Please review.

Project coverage is 70.97%. Comparing base (5131850) to head (ceed6f7).
Report is 1 commits behind head on main.

Files with missing lines	Patch %	Lines
crates/lakefs/src/logstore.rs	0.00%	260 Missing ⚠️
crates/lakefs/src/client.rs	0.00%	200 Missing ⚠️
python/src/lib.rs	0.00%	117 Missing ⚠️
crates/lakefs/src/storage.rs	0.00%	61 Missing ⚠️
crates/core/src/storage/mod.rs	41.02%	21 Missing and 2 partials ⚠️
crates/core/src/operations/transaction/mod.rs	68.57%	20 Missing and 2 partials ⚠️
crates/lakefs/src/lib.rs	0.00%	20 Missing ⚠️
crates/core/src/operations/set_tbl_properties.rs	0.00%	19 Missing ⚠️
crates/lakefs/src/errors.rs	0.00%	19 Missing ⚠️
crates/core/src/operations/add_column.rs	0.00%	18 Missing ⚠️
... and 22 more

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #3103      +/-   ##
==========================================
- Coverage   72.34%   70.97%   -1.38%     
==========================================
  Files         128      133       +5     
  Lines       41296    42454    +1158     
  Branches    41296    42454    +1158     
==========================================
+ Hits        29875    30130     +255     
- Misses       9504    10388     +884     
- Partials     1917     1936      +19     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.