Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Parquet reader list microkernel #16538

Draft
wants to merge 37 commits into
base: branch-24.12
Choose a base branch
from
Draft

Parquet reader list microkernel #16538

wants to merge 37 commits into from
+761 −206

Conversation

pmattione-nvidia
Copy link
Contributor

@pmattione-nvidia pmattione-nvidia commented Aug 12, 2024 •
edited
Loading

Description

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.

@github-actions github-actions bot added the libcudf Affects libcudf (C++/CUDA) code. label Aug 12, 2024
pmattione-nvidia and others added 28 commits August 16, 2024 16:19
@pmattione-nvidia
Further work in list code
2ca9618
@pmattione-nvidia
Tests working
4b5f91a
@pmattione-nvidia
Revert page_decode changes
ead17b8
@pmattione-nvidia
Merge branch 'branch-24.10' into parquet_list_kernel
cc32409
@pmattione-nvidia
Add debugging
0dccec5
@pmattione-nvidia
Tests working
e239e79
@pmattione-nvidia
Merge branch 'branch-24.10' into parquet_list_kernel
8f25453
@pmattione-nvidia
compile fixes
24c9ab1
@pmattione-nvidia
No need to decode def levels if not nullable
342c2f4
@pmattione-nvidia
Manual block scan
50bbc94
@pmattione-nvidia
Optimize parquet reader block scans, simplify and consolidate non-nul…
5390661 
…lable column code
@pmattione-nvidia
tweak syncing
3ef7b0d
@pmattione-nvidia
small tweaks
7882879
@pmattione-nvidia
Merge branch 'branch-24.10' into parquet_list_kernel
8852839
@pmattione-nvidia
Add skipping to rle_stream, use for lists (chunked reads)
e285fbf
@pmattione-nvidia
tweak scan interface for linked lists
254f3e9
@pmattione-nvidia
Merge branch 'branch-24.12' into mukernels_fixedwidth_optimize
18d989c
@pmattione-nvidia
style fixes
8ea1e0e
@pmattione-nvidia
Merge branch 'mukernels_fixedwidth_optimize' of https://github.com/pm…
326b386 
…attione-nvidia/cudf into mukernels_fixedwidth_optimize
@pmattione-nvidia @nvdbaranec
Update cpp/src/io/parquet/decode_fixed.cu
41cb982 
Co-authored-by: nvdbaranec <[email protected]>
@pmattione-nvidia @nvdbaranec
Update cpp/src/io/parquet/decode_fixed.cu
6e70554 
Co-authored-by: nvdbaranec <[email protected]>
@pmattione-nvidia @nvdbaranec
Update cpp/src/io/parquet/decode_fixed.cu
9ad4415 
Co-authored-by: nvdbaranec <[email protected]>
@pmattione-nvidia
Unroll block-count loop
3a1fc95
@pmattione-nvidia
Merge branch 'mukernels_fixedwidth_optimize' of https://github.com/pm…
0babf46 
…attione-nvidia/cudf into mukernels_fixedwidth_optimize
@pmattione-nvidia
more style fixes
5ab9829
@pmattione-nvidia
Merge branch 'branch-24.12' into mukernels_fixedwidth_optimize
310d50c
@pmattione-nvidia
Disable manual block scan for non-lists
4471022
@pmattione-nvidia @vuule
Update cpp/src/io/parquet/decode_fixed.cu
c0ed2cb 
Co-authored-by: Vukasin Milovanovic <[email protected]>
@pmattione-nvidia pmattione-nvidia changed the base branch from branch-24.10 to branch-24.12 October 7, 2024 14:15
@pmattione-nvidia pmattione-nvidia added improvement Improvement / enhancement to an existing function non-breaking Non-breaking change Performance Performance related issue labels Oct 7, 2024
@pmattione-nvidia pmattione-nvidia self-assigned this Oct 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@pmattione-nvidia pmattione-nvidia

Labels
improvement Improvement / enhancement to an existing function libcudf Affects libcudf (C++/CUDA) code. non-breaking Non-breaking change Performance Performance related issue
Projects
cuDF/Dask/Numba/UCX
Status: In Progress
libcudf
Status: Slip
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@pmattione-nvidia