Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Parquet reader list microkernel #16538

Draft
wants to merge 41 commits into
base: branch-24.12
Choose a base branch
from
Draft

Parquet reader list microkernel #16538

wants to merge 41 commits into from
+753 −213

Commits on Aug 12, 2024

  1. work in progress

    @pmattione-nvidia
    pmattione-nvidia committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    b5ec22e View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2024

  1. Further work in list code

    @pmattione-nvidia
    pmattione-nvidia committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    2ca9618 View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2024

  1. Tests working

    @pmattione-nvidia
    pmattione-nvidia committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    4b5f91a View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2024

  1. Revert page_decode changes

    @pmattione-nvidia
    pmattione-nvidia committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    ead17b8 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'branch-24.10' into parquet_list_kernel

    @pmattione-nvidia
    pmattione-nvidia authored Aug 28, 2024
    Configuration menu
    Copy the full SHA
    cc32409 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2024

  1. Add debugging

    @pmattione-nvidia
    pmattione-nvidia committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    0dccec5 View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2024

  1. Tests working

    @pmattione-nvidia
    pmattione-nvidia committed Sep 7, 2024
    Configuration menu
    Copy the full SHA
    e239e79 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'branch-24.10' into parquet_list_kernel

    @pmattione-nvidia
    pmattione-nvidia committed Sep 7, 2024
    Configuration menu
    Copy the full SHA
    8f25453 View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2024

  1. compile fixes

    @pmattione-nvidia
    pmattione-nvidia committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    24c9ab1 View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2024

  1. No need to decode def levels if not nullable

    @pmattione-nvidia
    pmattione-nvidia committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    342c2f4 View commit details
    Browse the repository at this point in the history

  2. Manual block scan

    @pmattione-nvidia
    pmattione-nvidia committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    50bbc94 View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2024

  1. Optimize parquet reader block scans, simplify and consolidate non-nul… 

    …lable column code
    @pmattione-nvidia
    pmattione-nvidia committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    5390661 View commit details
    Browse the repository at this point in the history

  2. tweak syncing

    @pmattione-nvidia
    pmattione-nvidia committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    3ef7b0d View commit details
    Browse the repository at this point in the history

  3. small tweaks

    @pmattione-nvidia
    pmattione-nvidia committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    7882879 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'branch-24.10' into parquet_list_kernel

    @pmattione-nvidia
    pmattione-nvidia committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    8852839 View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2024

  1. Add skipping to rle_stream, use for lists (chunked reads)

    @pmattione-nvidia
    pmattione-nvidia committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    e285fbf View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2024

  1. tweak scan interface for linked lists

    @pmattione-nvidia
    pmattione-nvidia committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    254f3e9 View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2024

  1. Merge branch 'branch-24.12' into mukernels_fixedwidth_optimize

    @pmattione-nvidia
    pmattione-nvidia authored Sep 25, 2024
    Configuration menu
    Copy the full SHA
    18d989c View commit details
    Browse the repository at this point in the history

  2. style fixes

    @pmattione-nvidia
    pmattione-nvidia committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    8ea1e0e View commit details
    Browse the repository at this point in the history

  3. Merge branch 'mukernels_fixedwidth_optimize' of https://github.com/pm… 

    …attione-nvidia/cudf into mukernels_fixedwidth_optimize
    @pmattione-nvidia
    pmattione-nvidia committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    326b386 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2024

  1. Update cpp/src/io/parquet/decode_fixed.cu 

    Co-authored-by: nvdbaranec <[email protected]>
    @pmattione-nvidia @nvdbaranec
    pmattione-nvidia and nvdbaranec authored Sep 26, 2024
    Configuration menu
    Copy the full SHA
    41cb982 View commit details
    Browse the repository at this point in the history

  2. Update cpp/src/io/parquet/decode_fixed.cu 

    Co-authored-by: nvdbaranec <[email protected]>
    @pmattione-nvidia @nvdbaranec
    pmattione-nvidia and nvdbaranec authored Sep 26, 2024
    Configuration menu
    Copy the full SHA
    6e70554 View commit details
    Browse the repository at this point in the history

  3. Update cpp/src/io/parquet/decode_fixed.cu 

    Co-authored-by: nvdbaranec <[email protected]>
    @pmattione-nvidia @nvdbaranec
    pmattione-nvidia and nvdbaranec authored Sep 26, 2024
    Configuration menu
    Copy the full SHA
    9ad4415 View commit details
    Browse the repository at this point in the history

  4. Unroll block-count loop

    @pmattione-nvidia
    pmattione-nvidia committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    3a1fc95 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'mukernels_fixedwidth_optimize' of https://github.com/pm… 

    …attione-nvidia/cudf into mukernels_fixedwidth_optimize
    @pmattione-nvidia
    pmattione-nvidia committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    0babf46 View commit details
    Browse the repository at this point in the history

  6. more style fixes

    @pmattione-nvidia
    pmattione-nvidia committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    5ab9829 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2024

  1. Merge branch 'branch-24.12' into mukernels_fixedwidth_optimize

    @pmattione-nvidia
    pmattione-nvidia authored Sep 27, 2024
    Configuration menu
    Copy the full SHA
    310d50c View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2024

  1. Disable manual block scan for non-lists

    @pmattione-nvidia
    pmattione-nvidia committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    4471022 View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2024

  1. Update cpp/src/io/parquet/decode_fixed.cu 

    Co-authored-by: Vukasin Milovanovic <[email protected]>
    @pmattione-nvidia @vuule
    pmattione-nvidia and vuule authored Oct 4, 2024
    Configuration menu
    Copy the full SHA
    c0ed2cb View commit details
    Browse the repository at this point in the history

  2. Merge branch 'mukernels_fixedwidth_optimize' of https://github.com/pm… 

    …attione-nvidia/cudf into mukernels_fixedwidth_optimize
    @pmattione-nvidia
    pmattione-nvidia committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    c2139ef View commit details
    Browse the repository at this point in the history

  3. Style fixes

    @pmattione-nvidia
    pmattione-nvidia committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    b898cba View commit details
    Browse the repository at this point in the history

Commits on Oct 7, 2024

  1. renaming

    @pmattione-nvidia
    pmattione-nvidia committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    b0ee9fc View commit details
    Browse the repository at this point in the history

  2. Merge branch 'mukernels_fixedwidth_optimize' into parquet_list_kernel

    @pmattione-nvidia
    pmattione-nvidia committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    36d026e View commit details
    Browse the repository at this point in the history

  3. minor tweaks

    @pmattione-nvidia
    pmattione-nvidia committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    4b7d1df View commit details
    Browse the repository at this point in the history

  4. delete some debug printing

    @pmattione-nvidia
    pmattione-nvidia committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    b36b3b2 View commit details
    Browse the repository at this point in the history

  5. Remove more prints

    @pmattione-nvidia
    pmattione-nvidia committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    5b15704 View commit details
    Browse the repository at this point in the history

Commits on Oct 8, 2024

  1. cleanup

    @pmattione-nvidia
    pmattione-nvidia committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    e84af82 View commit details
    Browse the repository at this point in the history

  2. cleanup comments

    @pmattione-nvidia
    pmattione-nvidia committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    f200748 View commit details
    Browse the repository at this point in the history

  3. style changes

    @pmattione-nvidia
    pmattione-nvidia committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    3fc76ee View commit details
    Browse the repository at this point in the history

  4. Merge branch 'rapidsai:branch-24.12' into parquet_list_kernel

    @pmattione-nvidia
    pmattione-nvidia authored Oct 8, 2024
    Configuration menu
    Copy the full SHA
    8c58d2b View commit details
    Browse the repository at this point in the history

  5. Merge branch 'parquet_list_kernel' of https://github.com/pmattione-nv… 

    …idia/cudf into parquet_list_kernel
    @pmattione-nvidia
    pmattione-nvidia committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    ae8e193 View commit details
    Browse the repository at this point in the history