Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add CSV data module Implementation for Ballerina #4

Merged
merged 176 commits into from
Oct 1, 2024
Merged
Show file tree
Hide file tree
Changes from 166 commits
Commits
Show all changes
176 commits
Select commit Hold shift + click to select a range
1dcb5c4
initial commit
SasinduDilshara Feb 15, 2024
bf83a37
Add toCsvString function
SasinduDilshara Feb 16, 2024
11481e7
Update `fromStringWithType` function
SasinduDilshara Feb 16, 2024
45f77d2
Update fromStringWithType function
SasinduDilshara Feb 16, 2024
3353ad4
Update json variables into csv variables
SasinduDilshara Feb 18, 2024
41270d7
Update csv var names
SasinduDilshara Feb 18, 2024
ee61184
Update error diagnostic codes
SasinduDilshara Feb 18, 2024
0f79b57
Remove nodestack from csv traversal
SasinduDilshara Feb 18, 2024
1dfcb0f
Update type of field hierachy and the rest type
SasinduDilshara Feb 18, 2024
f65b2ce
Remove unwanted fields in parser
SasinduDilshara Feb 18, 2024
0e81e8a
Refactor header states
SasinduDilshara Feb 18, 2024
a9d571a
Refactor csv parser
SasinduDilshara Feb 18, 2024
855f202
Add configs
SasinduDilshara Feb 19, 2024
03667ef
Refactor the code with user configurations
SasinduDilshara Feb 21, 2024
940fd33
Refactor the traversal function
SasinduDilshara Feb 21, 2024
4c9f9ad
Add usere configs and basic tests
SasinduDilshara Mar 6, 2024
ed3cbf4
Add tests for tuple source values
SasinduDilshara Mar 15, 2024
d9f3753
Add tests for csvWithType Functiojn
SasinduDilshara Mar 18, 2024
b7a93cd
Add record related tests for fromcsvstring with type function
SasinduDilshara Mar 20, 2024
23a025b
Add tests for arrays & maps for fromStringWithType
SasinduDilshara Mar 22, 2024
b6a379e
Add tests for config headers and custom headers
SasinduDilshara Mar 24, 2024
9074ecf
Add tests for several configs of header params
SasinduDilshara Mar 24, 2024
b1284ed
Update user configs
SasinduDilshara Mar 29, 2024
f89691c
Add test files for basic functionality
SasinduDilshara May 13, 2024
7bc30a5
Add user config tests
SasinduDilshara May 14, 2024
9b8c7f7
Add tests for comments and null configs
SasinduDilshara Jun 6, 2024
f2a4a1a
Add tests for customheaders
SasinduDilshara Jun 6, 2024
04388da
Add basic text enclosure property
SasinduDilshara Jun 9, 2024
090aec4
Add tests for escape characters and delimiters
SasinduDilshara Jun 10, 2024
31f7ab9
Add tests for line terminator
SasinduDilshara Jun 10, 2024
6c4444c
Add tests for nil config and data projection
SasinduDilshara Jun 13, 2024
a70c2a8
Add tests for name annotation
SasinduDilshara Jun 13, 2024
45399fe
Add Name config tests for records
SasinduDilshara Jun 13, 2024
f4b386d
Add type compatibility for string tuples
SasinduDilshara Jun 16, 2024
b0ee27c
Add intersection support
SasinduDilshara Jun 18, 2024
360ea4d
Add constraint validations
SasinduDilshara Jun 20, 2024
1f2c816
Add tests for internal union types
SasinduDilshara Jun 24, 2024
5bcc0d9
Add tests for union & intertsection types
SasinduDilshara Jun 25, 2024
e291761
Add tests for finite types
SasinduDilshara Jun 26, 2024
30fb9e4
Add implementation and tests for Singleton and subtypes
SasinduDilshara Jun 27, 2024
8b2f215
Add implementation for compiler plugin
SasinduDilshara Jul 2, 2024
5eb0918
[Automated] Update the native jar versions
SasinduDilshara Jul 2, 2024
1d21659
[Automated] Update the native jar versions
SasinduDilshara Jul 2, 2024
cfd8d2d
Add compiler plugin tests
SasinduDilshara Jul 2, 2024
61169f2
Update error type
SasinduDilshara Jul 5, 2024
41f02a7
Removed resolved comments in ballerina files
SasinduDilshara Jul 5, 2024
fec4c7b
Remove unwanted debug functions and logs
SasinduDilshara Jul 5, 2024
fb6d13b
[Automated] Update the native jar versions
SasinduDilshara Jul 5, 2024
85352b2
Add API documentations for public types
SasinduDilshara Jul 5, 2024
a1924d1
Remove the ReadMe description
SasinduDilshara Jul 5, 2024
d604598
Merge branch 'development' of https://github.com/ballerina-platform/m…
SasinduDilshara Jul 5, 2024
e4235af
Update git attributes for windows
SasinduDilshara Jul 5, 2024
58c4dbf
[Automated] Update the native jar versions
SasinduDilshara Jul 8, 2024
7ead985
Restructure the ballerina integration test structure
SasinduDilshara Jul 9, 2024
e4ae6d2
[Automated] Update the native jar versions
SasinduDilshara Jul 10, 2024
c7d0602
[Automated] Update the native jar versions
SasinduDilshara Jul 10, 2024
be14fe2
Fix new line character related issu in wiondows build
SasinduDilshara Jul 10, 2024
0ca601b
[Automated] Update the native jar versions
SasinduDilshara Jul 10, 2024
fe50cfa
[Automated] Update the native jar versions
SasinduDilshara Jul 11, 2024
f20fd85
[Automated] Update the native jar versions
SasinduDilshara Jul 11, 2024
f4f07ca
[Automated] Update the native jar versions
SasinduDilshara Jul 12, 2024
1eb6cf9
Add tests for byte and byte streams
SasinduDilshara Jul 12, 2024
916eff1
[Automated] Update the native jar versions
SasinduDilshara Jul 12, 2024
fba132a
Add tests for array indexes
SasinduDilshara Jul 12, 2024
6c1c405
[Automated] Update the native jar versions
SasinduDilshara Jul 12, 2024
658435d
Merge pull request #3 from SasinduDilshara/development-2
SasinduDilshara Jul 13, 2024
faa687a
[Automated] Update the native jar versions
SasinduDilshara Jul 15, 2024
efeba40
Update state parameter for default states
SasinduDilshara Jul 15, 2024
8e7ce81
Add ReadMe file for the csv data module
SasinduDilshara Jul 19, 2024
2713699
Merge pull request #6 from SasinduDilshara/development-2
SasinduDilshara Jul 19, 2024
ba2810d
[Automated] Update the native jar versions
SasinduDilshara Jul 23, 2024
66a468f
[Automated] Update the native jar versions
SasinduDilshara Jul 23, 2024
d17568b
Add locale support for csv data
SasinduDilshara Jul 23, 2024
9aecee4
Merge pull request #8 from SasinduDilshara/development-2
SasinduDilshara Jul 25, 2024
16a0ef2
[Automated] Update the native jar versions
SasinduDilshara Jul 26, 2024
d7bc2e5
[Automated] Update the native jar versions
SasinduDilshara Jul 26, 2024
dd4ca57
Add french locale to graalvm build options
SasinduDilshara Jul 26, 2024
4659b43
Add locale build option for build config toml
SasinduDilshara Jul 26, 2024
b92cb2c
Remove locale configs from user config tests
SasinduDilshara Jul 26, 2024
9409dd3
Merge pull request #9 from SasinduDilshara/development-2
SasinduDilshara Jul 26, 2024
04f2e77
[Automated] Update the native jar versions
SasinduDilshara Jul 29, 2024
8efea67
[Automated] Update the native jar versions
SasinduDilshara Jul 29, 2024
e370a85
[Automated] Update the native jar versions
SasinduDilshara Jul 29, 2024
15c2811
Add licenses for tests & add java17 features for native
SasinduDilshara Jul 29, 2024
b601798
[Automated] Update the native jar versions
SasinduDilshara Jul 29, 2024
08d583f
[Automated] Update the native jar versions
SasinduDilshara Jul 29, 2024
e4184a6
Add more tests for compiler plugin tests
SasinduDilshara Jul 29, 2024
d1d227b
Merge pull request #10 from SasinduDilshara/development-2
SasinduDilshara Jul 29, 2024
42b2c5b
[Automated] Update the native jar versions
SasinduDilshara Jul 29, 2024
4ad18c3
Change package path to lib & refactor test variables
SasinduDilshara Jul 29, 2024
c193656
Add type cast for consitions
SasinduDilshara Jul 30, 2024
e4b0d2e
Merge pull request #11 from SasinduDilshara/development-2
SasinduDilshara Jul 30, 2024
6f549a0
Add ballerina files to code coverage tests
SasinduDilshara Jul 30, 2024
2a85483
Update graalvm properties
SasinduDilshara Jul 30, 2024
4b0e9d2
Update test function for locale
SasinduDilshara Jul 30, 2024
478086b
Merge pull request #12 from SasinduDilshara/development-2
SasinduDilshara Jul 30, 2024
dc585b7
Add tests for compiler plugin
SasinduDilshara Jul 30, 2024
96fe8b4
Remove unused imports in compiler plugin testsd
SasinduDilshara Jul 30, 2024
f81a973
Merge pull request #13 from SasinduDilshara/development-2
SasinduDilshara Jul 30, 2024
72a9f41
Add more tests to locale
SasinduDilshara Jul 31, 2024
68a0260
Remove .gitignore files and add codecov configs
SasinduDilshara Jul 31, 2024
cc73513
Merge pull request #14 from SasinduDilshara/development-2
SasinduDilshara Jul 31, 2024
9ce93c4
Update api docs in user configs
SasinduDilshara Jul 31, 2024
77df3d1
Merge pull request #15 from SasinduDilshara/development-2
SasinduDilshara Aug 1, 2024
d7ee80f
Add codecov configurations for codecov yaml
SasinduDilshara Aug 1, 2024
b780eba
Merge pull request #16 from SasinduDilshara/development-2
SasinduDilshara Aug 1, 2024
db2d25e
Use module level constant vars for constant values
SasinduDilshara Aug 1, 2024
32aa1ae
Revert changes done for constructArrayValuesFromArray
SasinduDilshara Aug 1, 2024
fa779e6
Merge pull request #17 from SasinduDilshara/development-2
SasinduDilshara Aug 1, 2024
679e418
[Automated] Update the native jar versions
SasinduDilshara Aug 1, 2024
e80669f
Update lang version into update 10
SasinduDilshara Aug 1, 2024
92068b4
Merge pull request #18 from SasinduDilshara/development-2
SasinduDilshara Aug 1, 2024
0aadbbc
Change the module name in publishing release workflow
SasinduDilshara Aug 1, 2024
c06d54e
Merge pull request #19 from SasinduDilshara/development-2
SasinduDilshara Aug 1, 2024
1dbf1a5
Add package md as the readme file
SasinduDilshara Aug 1, 2024
ea628f7
[Automated] Update the native jar versions
SasinduDilshara Aug 1, 2024
b0d7055
publish native package for the maven central
SasinduDilshara Aug 1, 2024
3e44972
Change the parser option field names
SasinduDilshara Aug 1, 2024
7ecdfba
[Automated] Update the native jar versions
SasinduDilshara Aug 1, 2024
1b1023e
Merge pull request #20 from SasinduDilshara/development-2
SasinduDilshara Aug 1, 2024
82ab586
Add javadoc comments for the public java classes
SasinduDilshara Aug 1, 2024
146dc01
Merge pull request #21 from SasinduDilshara/development-2
SasinduDilshara Aug 1, 2024
25847ce
Add API related changes for arrays and custom headers
SasinduDilshara Aug 6, 2024
e0a0ad9
[Automated] Update the native jar versions
SasinduDilshara Aug 6, 2024
bcd5201
[Automated] Update the native jar versions
SasinduDilshara Aug 6, 2024
a747e71
[Automated] Update the native jar versions
SasinduDilshara Aug 6, 2024
1246a4e
Add outputheader param for parse strings, parse list to list APIs
SasinduDilshara Aug 6, 2024
37ca852
[Automated] Update the native jar versions
SasinduDilshara Aug 7, 2024
43bdb32
[Automated] Update the native jar versions
SasinduDilshara Aug 7, 2024
fb27c7d
Update the record and array basic operations with new design
SasinduDilshara Aug 7, 2024
8dee100
[Automated] Update the native jar versions
SasinduDilshara Aug 7, 2024
ebecb3a
[Automated] Update the native jar versions
SasinduDilshara Aug 7, 2024
08311d1
[Automated] Update the native jar versions
SasinduDilshara Aug 7, 2024
10ebeea
Add list related header param changes for transform api
SasinduDilshara Aug 7, 2024
9a06dd8
[Automated] Update the native jar versions
SasinduDilshara Aug 7, 2024
8aaffb8
Add union tests with headers for string source
SasinduDilshara Aug 7, 2024
26f2aa4
Add union tests for transform api
SasinduDilshara Aug 7, 2024
126092a
[Automated] Update the native jar versions
SasinduDilshara Aug 8, 2024
63531e6
Add tests for union types
SasinduDilshara Aug 8, 2024
b17d86a
Update compiler plugin tests with new api changes
SasinduDilshara Aug 8, 2024
e336a7a
Add constrained validation tests for lists
SasinduDilshara Aug 8, 2024
91d9a3d
Rename parse list api
SasinduDilshara Aug 8, 2024
dfba0c8
Remove string conversion parameter
SasinduDilshara Aug 8, 2024
a87e7ab
Update public apis in Ballerina
SasinduDilshara Aug 8, 2024
6e5e613
Update the ReadMe file
SasinduDilshara Aug 8, 2024
268decc
Merge pull request #22 from SasinduDilshara/development-revamp
SasinduDilshara Aug 8, 2024
1928804
Allow empty strings to represent nil values using configs
SasinduDilshara Aug 12, 2024
34bea43
Merge pull request #23 from SasinduDilshara/development-revamp
SasinduDilshara Aug 12, 2024
40eef57
Refactor user configuration parameter
SasinduDilshara Aug 12, 2024
0d98571
Merge pull request #24 from SasinduDilshara/development-revamp
SasinduDilshara Aug 12, 2024
23f2145
[Automated] Update the native jar versions
SasinduDilshara Aug 12, 2024
dae0fe5
[Automated] Update the native jar versions
SasinduDilshara Aug 12, 2024
563d7e8
Add compiler errors for ignored parameters
SasinduDilshara Aug 12, 2024
b02b9fb
Add test for a non-csv scenario
SasinduDilshara Aug 12, 2024
95720c0
Merge pull request #25 from SasinduDilshara/development-revamp
SasinduDilshara Aug 13, 2024
78aabf2
Update the order of union types
SasinduDilshara Aug 14, 2024
145ca8a
Add tests for slice operations
SasinduDilshara Aug 14, 2024
dfe61fa
Merge pull request #26 from SasinduDilshara/development-revamp
SasinduDilshara Aug 14, 2024
821b0b0
[Automated] Update the native jar versions
SasinduDilshara Aug 14, 2024
55ef446
[Automated] Update the native jar versions
SasinduDilshara Aug 15, 2024
978a6d0
[Automated] Update the native jar versions
SasinduDilshara Aug 15, 2024
0914fea
Update gradle scripts and compiler plugin errors
SasinduDilshara Aug 15, 2024
93b6f0e
Merge branch 'development' of https://github.com/ballerina-platform/m…
SasinduDilshara Aug 15, 2024
609c604
Merge pull request #27 from SasinduDilshara/refactor-gradle-files
SasinduDilshara Aug 15, 2024
1df7169
Add examples for api documentation
SasinduDilshara Aug 16, 2024
1cc4a07
Merge pull request #28 from SasinduDilshara/refactor-gradle-files
SasinduDilshara Aug 16, 2024
67530ea
Update csv api doc comments
SasinduDilshara Aug 20, 2024
c84fd71
Update gradle plugin version
SasinduDilshara Aug 20, 2024
96a395d
Merge pull request #29 from SasinduDilshara/refactor-gradle-files
SasinduDilshara Aug 20, 2024
6ab339a
Refactor APIs and API docs
SasinduDilshara Sep 3, 2024
52bf01b
Merge pull request #30 from SasinduDilshara/refactor-gradle-files
SasinduDilshara Sep 3, 2024
6794717
Update header parameter to be in nillable type
SasinduDilshara Sep 9, 2024
780ff5a
Merge pull request #31 from SasinduDilshara/refactor-gradle-files
SasinduDilshara Sep 9, 2024
b740397
Add unique id for thrad pool threads
SasinduDilshara Oct 1, 2024
3acca4f
Add a atomic integer as a thread id
SasinduDilshara Oct 1, 2024
3cc620a
Merge pull request #34 from SasinduDilshara/refactor-gradle-files
SasinduDilshara Oct 1, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions .github/workflows/build-with-bal-test-graalvm.yml
Original file line number Diff line number Diff line change
Expand Up @@ -35,3 +35,5 @@ jobs:
lang_tag: ${{ inputs.lang_tag }}
lang_version: ${{ inputs.lang_version }}
native_image_options: '-J-Xmx7G ${{ inputs.native_image_options }}'
# TODO : Enable after fixing this issue : https://github.com/ballerina-platform/ballerina-lang/issues/38882
additional_windows_build_flags: '-x test'
SasinduDilshara marked this conversation as resolved.
Show resolved Hide resolved
2 changes: 1 addition & 1 deletion .github/workflows/publish-release.yml
Original file line number Diff line number Diff line change
Expand Up @@ -12,5 +12,5 @@ jobs:
uses: ballerina-platform/ballerina-library/.github/workflows/release-package-template.yml@main
secrets: inherit
with:
package-name: data.jsondata
package-name: data.csv
package-org: ballerina
19 changes: 19 additions & 0 deletions .github/workflows/stale_check.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
name: 'Close stale pull requests'

on:
schedule:
- cron: '30 19 * * *'
workflow_dispatch:

jobs:
stale:
runs-on: ubuntu-latest
steps:
- uses: actions/stale@v3
with:
stale-pr-message: 'This PR has been open for more than 15 days with no activity. This will be closed in 3 days unless the `stale` label is removed or commented.'
close-pr-message: 'Closed PR due to inactivity for more than 18 days.'
days-before-pr-stale: 15
days-before-pr-close: 3
days-before-issue-stale: -1
days-before-issue-close: -1
3 changes: 2 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,7 @@
*.zip
*.tar.gz
*.rar
*.deb

# virtual machine crash logs, see http://www.java.com/en/download/help/error_hotspot.csv
hs_err_pid*
Expand All @@ -33,7 +34,7 @@ target
bin/

# IDEA Files
.idea/
.idea2/
*.iml
*.ipr
*.iws
Expand Down
Loading
Loading