Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Saas with core refactor #5081

Draft
wants to merge 88 commits into
base: main
Choose a base branch
from
Draft

Saas with core refactor #5081

wants to merge 88 commits into from

Conversation

san81
Copy link
Contributor

@san81 san81 commented Oct 17, 2024

Description

[Describe what this change achieves]

Issues Resolved

Resolves #[Issue number to be closed when this PR is merged]

Check List

  • New functionality includes testing.
  • New functionality has a documentation issue. Please link to it in this PR.
    • New functionality has javadoc added
  • Commits are signed with a real name per the DCO

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@san81
initial commit of the connector sdk
79c7097 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
initial commit of the saas jira source plugin
c4db7d8 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
Spring Dependency injection for Plugins is now working and it is init…
a0ecb4b 
…ializing isolated spring DI context for the plugin.

Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
improvided plugin DI context initialization
1b74575 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
Merge branch 'opensearch-project:main' into saas-connector-sdk
7d0ff17
@san81
working state with leader and worker scheduler start to pick up their…
b43149f 
… partition and work on it.

Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
Trying to save the progress in the lader partition
a4572cb 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
better naming and better organization of the classes
294a55f 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
added some additional classes
35b714a 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
module structure is in place now
bb5595a 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
removed unused import
3d76212 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
workers are starting to fetch the ticket details
d0de502 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
basic running state
45f428d 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
Writing to the buffer
3a6a013 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
much simpler working state
10e1190 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
better working state and change detection working as well but we need…
34ce66d 
… to look for a shutdown strategy to terminate the executor pool at the right time

Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
removed unwanted imports
e055455 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
ticket fetching is now made parallel
ab1143f 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
merging main
51d533e 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
using updated attribute name
6210f1e 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
Merge branch 'opensearch-project:main' into saas-connector-sdk
574e32f
@san81
removing changes not needed in this branch
5dee5d7 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
switching to use spring rest template
5f2de50 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
testing config inject
74e7e32 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
jira configuration object is now converted to configuration helper
e9472a2 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
Merge branch 'opensearch-project:main' into saas-connector-sdk
e6e198b
@san81
Merge remote-tracking branch 'origin/saas-connector-sdk' into saas-co…
d9e39db 
…nnector-sdk
@san81
OAUth2 handling added. Not fully functional yet
a3c5c24 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
core package introduced in the data-prepper-core module
16c7476 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
core package introduced in the data-prepper-parser module
06a5006 
Signed-off-by: Santhosh Gandhe <[email protected]>
san81 and others added 30 commits October 17, 2024 12:54
@san81
better organized servcice class and helper classes
3f9de0f 
Signed-off-by: Santhosh Gandhe <[email protected]>
@kkondaka @san81
Rename s3 sink object metadata config options (opensearch-project#5041)
801f5e3 
* Addressed review comments. Introduced a new config, will deprecate the old config

Signed-off-by: Kondaka <[email protected]>

* Addressed review comments. Introduced a new config for metadata

Signed-off-by: Kondaka <[email protected]>

* Addressed review comments. Created a separate class for object metadata

Signed-off-by: Kondaka <[email protected]>

* Addressed review comments.

Signed-off-by: Kondaka <[email protected]>

* Fixed indentation

Signed-off-by: Kondaka <[email protected]>

---------

Signed-off-by: Kondaka <[email protected]>
@sb2k16 @sbose2k21 @san81
Add change log for Data prepper 2.10 (opensearch-project#5064)
1cded13 
Signed-off-by: Souvik Bose <[email protected]>
Co-authored-by: Souvik Bose <[email protected]>
@kkondaka @san81
Fixed s3 sink config validation (opensearch-project#5063)
b637ba4 
* Fixed s3 sink config validation

Signed-off-by: Krishna Kondaka <[email protected]>

* Added test cases

Signed-off-by: Krishna Kondaka <[email protected]>

---------

Signed-off-by: Krishna Kondaka <[email protected]>
Co-authored-by: Krishna Kondaka <[email protected]>
@sb2k16 @sbose2k21 @san81
Json codec changes with specific json input codec config (opensearch-…
7da5d51 
…project#5054)

* Json codec changes with specific json input codec config

Signed-off-by: Souvik Bose <[email protected]>

* Modify the tests and address comments

Signed-off-by: Souvik Bose <[email protected]>

---------

Signed-off-by: Souvik Bose <[email protected]>
Co-authored-by: Souvik Bose <[email protected]>
@dlvenable @san81
Improvements to the schema for the key_value processor. (opensearch-p…
158c419 
…roject#5051)

Signed-off-by: David Venable <[email protected]>
@graytaylor0 @san81
Add validations on route expressions, clean up assertTrue validation …
0099033 
…messages (opensearch-project#5060)

Signed-off-by: Taylor Gray <[email protected]>
@san81
Setting up version number for future releases (opensearch-project#5058)
747a30d 
Setting up version number for future releases

Signed-off-by: Santhosh Gandhe <[email protected]>
@opensearch-trigger-bot @dlvenable @san81
Generated THIRD-PARTY file for 8a49dc7 (opensearch-project#5069)
3f245a5 
Signed-off-by: GitHub <[email protected]>
Co-authored-by: dlvenable <[email protected]>
@shenkw1 @san81
Schema edits and enhancements (opensearch-project#5062)
7683741 
* schema changes according to team review

Signed-off-by: Katherine Shen <[email protected]>
@sb2k16 @san81
Add release notes for data prepper release v2.10 (opensearch-project#…
906d63c 
…5061)

Add release notes for v2.10

Signed-off-by: Souvik Bose <[email protected]>
@san81
Introducing core package in the data-prepper-core module (opensearch-…
20e17a4 
…project#5056)

core package introduced in the data-prepper-core module

Signed-off-by: Santhosh Gandhe <[email protected]>
@shenkw1 @san81
fix embed links (opensearch-project#5072)
26976dc 
Signed-off-by: Katherine Shen <[email protected]>
@shenkw1 @san81
fix build break (opensearch-project#5075)
5792b97 
Signed-off-by: Katherine Shen <[email protected]>
@dlvenable @san81
Adding defaultValue to the @JsonProperty for processors. (opensearch-…
4533b52 
…project#5080)

Signed-off-by: David Venable <[email protected]>
@san81
Merge branch 'saas-with-core-refactor' of github.com:san81/data-prepp…
42ea543 
…er into saas-with-core-refactor
@san81
merging with main
a9700cf 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
Merge branch 'opensearch-project:main' into saas-with-core-refactor
3ecd1e4
@san81
to be in sync with main
97d7ec0 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
to be in sync with main
2c474ec 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
to be in sync with main
9febe93 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
removing unused imports
cf8afdf 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
removing unused imports
c8f4c58 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
matching with main
89af699 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
properly connected objects in the flow
ab51240 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
still needs to fix the auto renew case
e7edc3b 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
removed setter
5ea5143 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
removed unused imports
b178b90 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
Organized Auth providers
27f5d5b 
Signed-off-by: Santhosh Gandhe <[email protected]>
@san81
better naming
3a6a1a3 
Signed-off-by: Santhosh Gandhe <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@chenqi0805 chenqi0805 Awaiting requested review from chenqi0805 chenqi0805 will be requested when the pull request is marked ready for review chenqi0805 is a code owner

@engechas engechas Awaiting requested review from engechas engechas will be requested when the pull request is marked ready for review engechas is a code owner

@graytaylor0 graytaylor0 Awaiting requested review from graytaylor0 graytaylor0 will be requested when the pull request is marked ready for review graytaylor0 is a code owner

@dinujoh dinujoh Awaiting requested review from dinujoh dinujoh will be requested when the pull request is marked ready for review dinujoh is a code owner

@kkondaka kkondaka Awaiting requested review from kkondaka kkondaka will be requested when the pull request is marked ready for review kkondaka is a code owner

@KarstenSchnitter KarstenSchnitter Awaiting requested review from KarstenSchnitter KarstenSchnitter will be requested when the pull request is marked ready for review KarstenSchnitter is a code owner

@dlvenable dlvenable Awaiting requested review from dlvenable dlvenable will be requested when the pull request is marked ready for review dlvenable is a code owner

@oeyh oeyh Awaiting requested review from oeyh oeyh will be requested when the pull request is marked ready for review oeyh is a code owner

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
7 participants
@san81 @Galactus22625 @kkondaka @sb2k16 @dlvenable @graytaylor0 @shenkw1