Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Removes some unnecessary dependencies in the S3 sink and Parquet codecs #3275

Merged
merged 4 commits into from
Aug 29, 2023

Conversation

dlvenable
Copy link
Member

Description

This PR removes Hadoop HDFS and YARN, neither of which are used. Map-reduce is needed when testing.

Issues Resolved

N/A

Check List

  • New functionality includes testing.
  • New functionality has a documentation issue. Please link to it in this PR.
    • New functionality has javadoc added
  • Commits are signed with a real name per the DCO

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@dlvenable dlvenable mentioned this pull request Aug 29, 2023
4 tasks
@dlvenable dlvenable merged commit 005f2aa into opensearch-project:main Aug 29, 2023
26 checks passed
opensearch-trigger-bot bot pushed a commit that referenced this pull request Aug 29, 2023
…cs (#3275)

Removes some unnecessary dependencies in the S3 sink and Parquet codec projects. Updating the Parquet version to 1.13.1 consistently. Exclude HDFS client.

Signed-off-by: David Venable <[email protected]>
(cherry picked from commit 005f2aa)
dlvenable added a commit that referenced this pull request Aug 31, 2023
…cs (#3275) (#3283)

Removes some unnecessary dependencies in the S3 sink and Parquet codec projects. Updating the Parquet version to 1.13.1 consistently. Exclude HDFS client.

Signed-off-by: David Venable <[email protected]>
(cherry picked from commit 005f2aa)

Co-authored-by: David Venable <[email protected]>
@dlvenable dlvenable deleted the s3-related-cleanup branch November 13, 2023 19:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants