-
Notifications
You must be signed in to change notification settings - Fork 195
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
-Support for Sink Codecs #2986
-Support for Sink Codecs #2986
Conversation
Signed-off-by: umairofficial <[email protected]>
Signed-off-by: umairofficial <[email protected]>
Signed-off-by: umairofficial <[email protected]>
Signed-off-by: umairofficial <[email protected]>
Signed-off-by: umairofficial <[email protected]>
Signed-off-by: umairofficial <[email protected]>
Signed-off-by: umairofficial <[email protected]>
Signed-off-by: umairofficial <[email protected]>
# Conflicts: # data-prepper-plugins/parse-json-processor/src/test/java/org/opensearch/dataprepper/plugins/codec/json/JsonOutputCodecTest.java # data-prepper-plugins/parse-json-processor/src/test/java/org/opensearch/dataprepper/plugins/codec/json/NewlineDelimitedOutputCodecTest.java # data-prepper-plugins/s3-sink/build.gradle # data-prepper-plugins/s3-sink/src/integrationTest/java/org/opensearch/dataprepper/plugins/sink/S3SinkServiceIT.java
Signed-off-by: umairofficial <[email protected]>
Signed-off-by: umairofficial <[email protected]>
Signed-off-by: umairofficial <[email protected]>
Signed-off-by: umairofficial <[email protected]>
Signed-off-by: umairofficial <[email protected]>
@Size(max = 0, message = "Schema from file is not supported.") | ||
@JsonProperty("region") | ||
private String region; | ||
|
||
@Valid | ||
@Size(max = 0, message = "Schema from file is not supported.") | ||
@JsonProperty("bucket_name") | ||
private String bucketName; | ||
|
||
@Valid | ||
@Size(max = 0, message = "Schema from file is not supported.") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The error messages on these are copied from schema_file_location
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Merging this for now. Please fix this @umayr-codes
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
These error messages were written in accordance with Ashok's suggestion!
@Size(max = 0, message = "Header from file is not supported.") | ||
@JsonProperty("region") | ||
private String region; | ||
@Valid | ||
@Size(max = 0, message = "Header from file is not supported.") | ||
@JsonProperty("bucket_name") | ||
private String bucketName; | ||
@Valid | ||
@Size(max = 0, message = "Header from file is not supported.") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This error message is copied from header_file_location
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Merging this for now. Please fix this @umayr-codes
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
These error messages were written in accordance with Ashok's suggestion!
Signed-off-by: umairofficial [email protected]
Description
AvroSinkCodec
,JsonSinkCodec
&CsvSinkCodec
implementation addedconfig
classes for the respective sink codecs addedInputCodecs
addedS3Sink
addedReadme.md
files updatedIssues Resolved
Resolves #2403
Check List
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.