Releases: GoogleCloudPlatform/gcsfuse
Releases · GoogleCloudPlatform/gcsfuse
Gcsfuse v1.3.0
- Added support for Log rotation in gcsfuse. Please note that this will be enabled by default. For more details - https://cloud.google.com/storage/docs/gcsfuse-config-file
- Security fixes:
- Upgraded golang version from 1.21.3 to 1.21.4.
- Upgraded go-storage-client module from 1.31.0 to 1.34.1 with their dependencies. The following security vulnerabilities are resolved as part of this upgrade:
What's Changed
- Bump certifi from 2023.5.7 to 2023.7.22 in /perfmetrics/scripts/bigquery by @dependabot in #1468
- Bump urllib3 from 1.26.16 to 1.26.18 in /perfmetrics/scripts/bigquery by @dependabot in #1469
- Bump urllib3 from 1.26.15 to 1.26.18 in /perfmetrics/scripts/load_tests/python by @dependabot in #1448
- Bump werkzeug from 2.3.4 to 3.0.1 in /perfmetrics/scripts/load_tests/python by @dependabot in #1466
- Creating big query tables for perf tests - 3 by @Tulsishah in #1450
- Fix pr perf test by @Tulsishah in #1490
- Build script and config files to run periodic tests on different branches by @Tulsishah in #1455
- Add exec-mode to script files by @gargnitingoogle in #1486
- Support --config-file flag for periodic perf tests by @Tulsishah in #1493
- Remove chmod calls for running scripts by @gargnitingoogle in #1489
- Fix experimental periodic perf test by @Tulsishah in #1499
- Change branch name and end date by @Tulsishah in #1509
- Collate fio installations at one place by @gargnitingoogle in #1506
- Fix clat-percentile accuracy in fio by @gargnitingoogle in #1503
- Run periodic tests for read cache branch with cache enabled by @sethiay in #1515
- Upgrade tensorflow model dependencies by @ashmeenkaur in #1510
- Pytorch 2 support by @Tulsishah in #1513
- Fix inverted commas in pytorch setup by @Tulsishah in #1527
- Upgrading go version 1.21.3 to 1.21.4 by @Tulsishah in #1525
- Bring changes from dec_2023_release branch into master branch by @gargnitingoogle in #1530
- Remove Image recognition models by @Tulsishah in #1483
- Update install test.sh with public documentation install commands by @ashmeenkaur in #1496
- add configs for log rotation by @ashmeenkaur in #1505
- Update installation steps for not using apt-key by @sethiay in #1498
- Integrate with lumberjack for log rotation by @ashmeenkaur in #1504
- Rename log rotate config by @ashmeenkaur in #1520
- Upgrade go storage pkg from 1.31.0 to 1.34.1 by @Tulsishah in #1491
- Fix tf-resnet model failure by @Tulsishah in #1536
- make log compression on by default by @ashmeenkaur in #1537
Full Changelog: v1.2.1...v1.3.0
Contributors
sethiay, dependabot, and 3 other contributors
Assets 6
Gcsfuse v1.2.1
- Fixes in –max-retry-duration and –max-retry-sleep flags behaviors:
- Before Gcsfuse v1.2.1: –max-retry-duration flag was doing the job of –max-retry-sleep flag and –max-retry-sleep flag was unused (no effect on setting it).
- With Gcsfuse v1.2.1: –max-retry-sleep flag aligns to its documented behavior and –max-retry-duration flag is unused (no effect on setting it).
- Note: If you have been using --max-retry-duration or –max-retry-sleep, please review the changes carefully and update your mount commands accordingly.
- Upgraded golang version from 1.21.0 to 1.21.3. CVEs fixed are listed below:
Gcsfuse v1.2.0
- Improved performance by removing zero-byte file creation during write flow (details here).
- GCSFuse is now available for use on arm64-based machines.
- Improved logging - by supporting different log-levels (documentation here).
- Improved coverage by adding more e2e/integration tests.
- Added new flag --config-file which supports specifying new flags via yaml file (documentation here).
- Upgraded go version from 1.20.5 to 1.21.0.
Gcsfuse v1.1.0
- Reading compressed objects (gzip) in compressed format is now supported.
- Deprecated --enable-storage-client-library flag. With this deprecation, GCSfuse will always use the Go Storage client to interact with GCS. Please reach out to us on Discussions or Issues section in case you face any issues with the deprecation.
- Changed name of --endpoint flag to --custom-endpoint. Note: When --custom-endpoint is specified, authentication with the endpoint is disabled.
- Upgraded versions of couple of dependencies i.e. Go Storage client version from 1.29.0 to 1.31.0 & jacobsa/fuse.
- Shifted from custom implementation of rate limiter to Go’s rate limiter. No changes in the functionality.
- Added more e2e/integration tests.
- Minor bug fixes in tests & build packages.
Gcsfuse v1.0.1
Major changes in this release
- Updated go version to 1.20.5 from 1.20.4
- Included copyright file in debian and rpm packages
- Added rpm digest while creating rpm package
Full set of what's changed
- Creating script to execute integration tests by @Tulsishah in #1202
- Handle the error variables and filehandles properly across all integration tests by @Tulsishah in #1197
- List large dir integration test by @Tulsishah in #1174
- Updating README.md to include GA status by @vadlakondaswetha in #1206
- Copy empty dir integration tests by @Tulsishah in #1205
- Delete implicit dir integration test by @Tulsishah in #1203
- Changing the machine spec from 1 GPU to 2 GPUs by @sethiay in #1208
- Correction in GPU creation command by @sethiay in #1212
- Updating issue template for adding issue SLO by @Tulsishah in #1216
- Integration tests --key-file flag and GOOGLE_APPLICATION_CREDENTIALS env with admin permission tests by @Tulsishah in #1167
- Changing the number of epoch based on previous run by @raj-prince in #1222
- Adding rpm digest while creating rpm package by @raj-prince in #1215
- Fixing open file issue by @Tulsishah in #1223
- Added CD pipeline scripts by @ashmeenkaur in #1224
- Integration tests for key-file flag with viewer permission tests by @Tulsishah in #1228
- Get dir attribute integration tests by @Tulsishah in #1220
- Persistent mounting integration tests by @Tulsishah in #1218
- Move directory integration tests by @Tulsishah in #1230
- Add copyright file by @ashmeenkaur in #1225
- Kokoro perf test fix - Integration tests by @Tulsishah in #1239
- Minor update to CD pipeline test script by @ashmeenkaur in #1238
- Sequentially read large file by @Tulsishah in #1233
- Creds test error fixing Integration tests by @Tulsishah in #1241
- Upgrade to go version 1.20.5 (#1196) by @gargnitingoogle in #1236
New Contributors
- @gargnitingoogle made their first contribution in #1236
Full Changelog: v1.0.0...v1.0.1
Contributors
raj-prince, sethiay, and 4 other contributors
Assets 4
Gcsfuse v1.0.0
Major changes in this release
- This release is tied to the GA (General Availability) of gcsfuse.
- Moved some of the documentation from gcsfuse/docs to
https://cloud.google.com/storage/docs/gcs-fuse and other pages under it. - Updated go version to 1.20.4 from 1.20.3
Full set of what's changed
- Error in printing "-" in installation doc by @Tulsishah in #1136
- Running all the integration test with --only-dir mounting by @Tulsishah in #1100
- Copying gcsfuse logs and fio output to gcs bucket via Kokoro by @vadlakondaswetha in #1140
- Updating go version 1.20.3 to 1.20.4 by @Tulsishah in #1141
- Update mounting doc to add instructions for service account auth by @ashmeenkaur in #1144
- Kokoro perf test fix checkout master by @Tulsishah in #1153
- Add TestInstalledPackage flag to integration testing. by @ashmeenkaur in #1150
- Fixing integration tests by @Tulsishah in #1157
- Update installing.md to point to new cloud.google.com doc by @cbonnie in #1152
- Removing experimental wording from stackdriver flag's description by @raj-prince in #1166
- Fixing kokoro perf test issue by @Tulsishah in #1165
- Fix lint failures by @ashmeenkaur in #1122
- Adding logs to print all the fio job timing by @raj-prince in #1169
- List Integration tests by @Tulsishah in #1149
- Add command to unmount fs mounted by mount command by @sethiay in #1171
- Delete Directory integration tests by @Tulsishah in #1172
- Stale Github Action Integration by @ashmeenkaur in #1176
- Adding integration test for creating three level directory by @Tulsishah in #1177
- Printing overall fio execution start and end time by @raj-prince in #1178
- Implicit dir Integration tests by @Tulsishah in #1170
- Kokoro perf test fix by @Tulsishah in #1168
- Fixed false error for implicit dir in rename and remove directory flow by @ashmeenkaur in #1186
- Update performance.md to point to new doc on cloud.google.com by @cbonnie in #1188
- Update README.md to point to new docs links on cloud.google.com by @cbonnie in #1187
- Update mounting.md to point to new doc by @cbonnie in #1182
- upgrading go version to 1.20.5 by @vadlakondaswetha in #1196
- Upgrade ai ml tests to successfully run for long duration on another VM by @sethiay in #1147
- fix integration test by @ashmeenkaur in #1181
- [execute-perf-test] Revert " upgrading go version to 1.20.5" by @vadlakondaswetha in #1198
New Contributors
Full Changelog: v0.42.5...v1.0.0
Contributors
raj-prince, sethiay, and 4 other contributors
Assets 4
Gcsfuse v0.42.5
Overall
- Added integration tests
- Removed logs under --debug_fs flag.
- Updated docs
- Removed vendor folder
- Add "(GPN: gcsfuse-)" to useragent for partner data tracking
- Log crash during mounting
- Fixed gem vulnerability issue in Dockerfile
What's Changed
- Fix: create delete list integration tests by @Tulsishah in #1073
- Removing all the logs which is used under --debug_fs flag by @raj-prince in #1074
- StatObejct Integration Tests[Read only file system] by @Tulsishah in #1079
- Updating Installtaion doc by @Tulsishah in #1081
- Update gsheet data only when perf tests run through kokoro by @Tulsishah in #1077
- Updating go version by @Tulsishah in #1082
- Read, Write, Copy, Rename tests [Readonly Filesystem] by @Tulsishah in #1080
- Adding vendor folder to gitignore file by @raj-prince in #1085
- Add _netdev option to troubleshooting doc by @sethiay in #1062
- Run readonly tests with mount dir option by @Tulsishah in #1086
- Update bucket names in CI tests to point in new GCP project by @sethiay in #1083
- Checkout back to master branch in periodic tests to use latest CI test scripts by @sethiay in #1089
- Adding the gcsfuse stuck issue in troubleshoot doc by @raj-prince in #1091
- Fixing the build failure using go get command by @raj-prince in #1094
- Adding remove dir before running tests by @Tulsishah in #1098
- Fixing gem vulnerability issue in Dockerfile by @raj-prince in #1093
- Updating semantic docs: unlinking directory by @raj-prince in #1101
- Adding the execution directory in the go build command by @raj-prince in #1099
- Upgrading the fuse go module to suppress error logs for GetXAttrs call by @raj-prince in #1102
- Fix pip-vulnerability fixes in gcsfuse metrics extraction by @raj-prince in #1096
- Fixing pip installation vulnerability in ls_metrics script by @raj-prince in #1095
- Changing implicit dir name from integration tests by @Tulsishah in #1104
- Update protobuf version as suggested in dependabot alert by @sethiay in #1108
- Create helper function for file operations by @Tulsishah in #1106
- Add "(GPN: gcsfuse-)" to useragent for partner data tracking. by @ashmeenkaur in #1072
- Rename directory integration test by @Tulsishah in #1103
- Revert "Add "(GPN: gcsfuse-)" to useragent for partner data tracking." by @ashmeenkaur in #1109
- Use the same steps to build gcsfuse in periodic test as used while releasing by @sethiay in #1110
- Creating helper functions for directory by @Tulsishah in #1112
- Move File Integration test by @Tulsishah in #1097
- Added timeout to golangci-lint as it is fails with timeout error by @ashmeenkaur in #1113
- Pip vulnerability by @sethiay in #1114
- Update gcsfuse-bug-report.md by @raj-prince in #1116
- Update gcsfuse-bug-report.md by @raj-prince in #1117
- Update pull_request_template.md by @raj-prince in #1118
- Removing condition in setup mounting by @Tulsishah in #1115
- Add "(GPN: gcsfuse-)" to useragent by @ashmeenkaur in #1111
- Upgrade torch and torchvision versions by @sethiay in #1127
- Adding delete file tests and refactor old tests by @Tulsishah in #1130
- Log crash during mounting by @Tulsishah in #1092
- [execute-perf-test] Fixing kokoro tests which are failing with disk space error. by @vadlakondaswetha in #1133
- fixing kokoro script by @vadlakondaswetha in #1134
- Copy directory integration tests by @Tulsishah in #1131
- retracting v1.0.0 by @Tulsishah in #1135
Full Changelog: v0.42.4...v0.42.5
Contributors
raj-prince, sethiay, and 3 other contributors
Assets 4
Gcsfuse v0.42.4
Overall
- Fixed the issue in storage-client library to support
--billing-projectoption - Integration tests for read-only file system.
- Correcting logs written to the syslog for text-format
- Add http timeout
- Change maintainer from jacobsa to gcs-fuse-dev
- List obj fix (#1060)
What's Changed
- Update GCSFuse release version(0.42.3) in installation doc by @Tulsishah in #1023
- Removing TmpDir from IntegrationTests by @Tulsishah in #1022
- Pull request template by @Tulsishah in #966
- Adding -o ro in gcsfuse help by @Tulsishah in #1021
- Fixing the version of tensorflow used in load_test script by @Tulsishah in #1025
- Updating playbook by @Tulsishah in #1027
- Updating mounting doc by @Tulsishah in #1030
- Updating semantic doc by @Tulsishah in #1031
- Updating installtion doc by @Tulsishah in #1029
- Updating go routine version to 1.19.7 by @Tulsishah in #1028
- Fix typos in upgrade instructions by @zchenyu in #1036
- Updating gcsfuse flags support by @Tulsishah in #1035
- Update help text by @Tulsishah in #1038
- Setting O_DIRECT flag in Integration tests by @Tulsishah in #1041
- Updating content in mounting doc as user guide updated by @Tulsishah in #1042
- Fixing Pull Request template by @Tulsishah in #1037
- Setup for main function integration test by @Tulsishah in #1045
- Performance doc by @Tulsishah in #1032
- Returning correct system error for un-implemented method by @raj-prince in #1046
- Updating Readme by @Tulsishah in #1033
- Updating link in doc by @Tulsishah in #1047
- Updating Benchmark doc by @Tulsishah in #1048
- Fixing load-script related to process_id and thread_id by @raj-prince in #1051
- Updating the description for --debug_http flag by @raj-prince in #1052
- Passing billing-project while creating bucket for storage-client-library by @raj-prince in #1050
- Creating a text/json writer wrapping over standard output logging writer by @raj-prince in #1056
- Skip integration test by @Tulsishah in #1058
- Merging logs written to the syslog for text-format by @raj-prince in #1018
- Adding integration tests in kokoro tests by @Tulsishah in #1059
- Add http timeout by @sethiay in #1061
- [Doc Update] Fixed gcsfuse --only-dir flag usage example. by @ashmeenkaur in #1066
- Change maintainer from jacobsa to gcs-fuse-dev by @sethiay in #1063
- List obj fix by @sethiay in #1060
- Setup for readonly test by @Tulsishah in #1064
- Kokoro fix by @Tulsishah in #1068
- Readonly Integration Tests - Create, Delete, List by @Tulsishah in #1067
New Contributors
- @zchenyu made their first contribution in #1036
- @ashmeenkaur made their first contribution in #1066
Full Changelog: v0.42.3...v0.42.4
Contributors
zchenyu, raj-prince, and 3 other contributors
Assets 4
Gcsfuse v0.42.3
- Integration tests setup
- Fixing: mount_gcsfuse not respecting bool values when passed to bool flags e.g. enable_storage_client_library
Gcsfuse v0.42.2
- Fixed mounting issues with --enable-storage-client-library=true.
- Support optional negative entries(NonExistentType) in type cache.
- Support optional log rotation with syslog and custom log file (--log-file).
See docs/logging for more details. - Made CreateObject, ComposeObject and DeleteObject methods with --enable-storage-client-library=true idempotent.
- Minor fixes and improvements.