Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add put method for Collections #219

Merged
merged 5 commits into from
Sep 18, 2024
Merged

Conversation

kjsanger
Copy link
Member

Change defaults for checksum-related API method keywords to False in order to make behaviour and responsibility for the decision clearer. API callers are now responsible for setting these flags to True where they are needed.

Separate checksum retrieval, updates and verification more clearly.

Add a checkum keyword to DataObject::list.

Add checksum size/consistency check for zero-length data objects.

@kjsanger kjsanger force-pushed the feature/baton-4.3.1 branch 4 times, most recently from fe0f088 to 8f7c38c Compare September 17, 2024 09:51
Change defaults for checksum-related API method keywords to False in
order to make behaviour and responsibility for the decision clearer.
API callers are now responsible for setting these flags to True where
they are needed.

Separate checksum retrieval, updates and verification more clearly.

Add a checkum keyword to DataObject::list.

Add checksum size/consistency check for zero-length data objects.
Adding this parameter allows a callable to be supplied which can
obtain per-file checksums during a recursive put operation. e.g. by
reading from an accompanying .md5 file or by deciding, based on file
size, whether to calculate checksums or to insist that an earlier
process supply one pre-calculated.

Improve test coverage of checksum operations.
This check make re-running tests more reliable in cases where the test
teardown has failed to remove test groups from iRODS.
Copy link

@nerdstrike nerdstrike left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some minor mistakes and a couple of questions for you. Hard for me to tell if you missed any implications from changing the defaults on checksum calculation

tests/test_irods.py Outdated Show resolved Hide resolved
tests/test_irods.py Outdated Show resolved Hide resolved
tests/test_irods.py Outdated Show resolved Hide resolved
tests/test_irods.py Outdated Show resolved Hide resolved
tests/test_irods.py Show resolved Hide resolved
tests/test_irods.py Show resolved Hide resolved
src/partisan/irods.py Outdated Show resolved Hide resolved
src/partisan/irods.py Outdated Show resolved Hide resolved
src/partisan/irods.py Show resolved Hide resolved
@kjsanger kjsanger merged commit c93caa0 into wtsi-npg:devel Sep 18, 2024
6 checks passed
@kjsanger kjsanger deleted the feature/baton-4.3.1 branch September 18, 2024 13:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants