Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

922 preprocessor acceleration #1004

Merged
merged 72 commits into from
Dec 11, 2023
Merged

922 preprocessor acceleration #1004

merged 72 commits into from
Dec 11, 2023

Commits on Nov 22, 2023

  1. accelerated define_column_types

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    f2cacc2 View commit details
    Browse the repository at this point in the history

  2. hotfix for pytests

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    4a5a2cf View commit details
    Browse the repository at this point in the history

  3. accelerated _clean_extra_spaces

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    c0bff91 View commit details
    Browse the repository at this point in the history

  4. convert num col to str optimized

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    986d534 View commit details
    Browse the repository at this point in the history

  5. type inference fixes

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    c594f81 View commit details
    Browse the repository at this point in the history

  6. categorical.py/data_preprocessing.py refactored

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    54d10ee View commit details
    Browse the repository at this point in the history

  7. fixed replacing inf with nan

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    fcabc4d View commit details
    Browse the repository at this point in the history

  8. label encoder same refactoring

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    cf9447a View commit details
    Browse the repository at this point in the history

  9. logical fix in label encoder

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    7431c98 View commit details
    Browse the repository at this point in the history

  10. nans with cats in unique func fix

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    a8b9c90 View commit details
    Browse the repository at this point in the history

  11. types fixes

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    243df8e View commit details
    Browse the repository at this point in the history

  12. minor improvements

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    b6d5e77 View commit details
    Browse the repository at this point in the history

  13. minor conversation fix from PR

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    21f4ce4 View commit details
    Browse the repository at this point in the history

  14. fix format + rename semantically

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    001d8b1 View commit details
    Browse the repository at this point in the history

  15. PR fixes 

    * rid of str variables for types in preprocessor
* improved define column_types function in data_types.py
    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    267f704 View commit details
    Browse the repository at this point in the history

  16. PR fixes

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    d2d0f9e View commit details
    Browse the repository at this point in the history

  17. style fixes

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    466a3ea View commit details
    Browse the repository at this point in the history

  18. array creation via multiplication fix

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    3978514 View commit details
    Browse the repository at this point in the history

  19. unified unimodal methods

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    f5e1589 View commit details
    Browse the repository at this point in the history

  20. +OperationTypesRepository type in operation.py

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    806acd1 View commit details
    Browse the repository at this point in the history

  21. add safer version of enum/strategies imports

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    d6dd5a9 View commit details
    Browse the repository at this point in the history

  22. optimizations and style fixes

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    b6ecf9a View commit details
    Browse the repository at this point in the history

  23. set psutil req with the one from golem

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    08712b3 View commit details
    Browse the repository at this point in the history

  24. bug fix

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    571157c View commit details
    Browse the repository at this point in the history

  25. nan to num optimization

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    b2e5f82 View commit details
    Browse the repository at this point in the history

  26. optimized cat features transform

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    4d42edb View commit details
    Browse the repository at this point in the history

  27. rid of for loops (v1)

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    8f96d2d View commit details
    Browse the repository at this point in the history

  28. compound names fix

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    7568b2b View commit details
    Browse the repository at this point in the history

  29. simplified data_preprocessing.py

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    d566947 View commit details
    Browse the repository at this point in the history

  30. data_preprocessing logic fix

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    eb7e28a View commit details
    Browse the repository at this point in the history

  31. numpy's nonzero to flatzero

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    2247e02 View commit details
    Browse the repository at this point in the history

  32. simplified data_types.py

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    9443d21 View commit details
    Browse the repository at this point in the history

  33. further opts

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    adc77b6 View commit details
    Browse the repository at this point in the history

  34. cats ids via numpy

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    5570180 View commit details
    Browse the repository at this point in the history

  35. numpy arr extend fix

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    1c044ee View commit details
    Browse the repository at this point in the history

  36. data_types.py cleanup

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    71560df View commit details
    Browse the repository at this point in the history

  37. lint fixes

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    9e89a92 View commit details
    Browse the repository at this point in the history

  38. lint fixes (v2)

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    b91a993 View commit details
    Browse the repository at this point in the history

  39. supp_data typing upd

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    74fe8b8 View commit details
    Browse the repository at this point in the history

  40. ensure all column_types are of ndarray type

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    d3534d0 View commit details
    Browse the repository at this point in the history

  41. column types naming fix

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    08e221e View commit details
    Browse the repository at this point in the history

  42. remove unused f-string signs

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    f9e47cf View commit details
    Browse the repository at this point in the history

  43. minor fixes

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    415bb0b View commit details
    Browse the repository at this point in the history

  44. minor dct update fix

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    3d70436 View commit details
    Browse the repository at this point in the history

  45. data_types.py further vectorization

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    6be9b2c View commit details
    Browse the repository at this point in the history

  46. preprocessing simplifications and logical fixes

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    d39e623 View commit details
    Browse the repository at this point in the history

  47. minor test lint fix

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    280822e View commit details
    Browse the repository at this point in the history

  48. minor polishing

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    e2e287a View commit details
    Browse the repository at this point in the history

  49. applymap simplification data_types.py

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    752b4ac View commit details
    Browse the repository at this point in the history

  50. test_pipeline.py increase time constraint

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    0148e35 View commit details
    Browse the repository at this point in the history

  51. rename all *types to *type_ids

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    432d9ea View commit details
    Browse the repository at this point in the history

  52. rename column_types to col_type_ids

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    3c338d9 View commit details
    Browse the repository at this point in the history

  53. pandas version fix

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    3fddcc8 View commit details
    Browse the repository at this point in the history

  54. inf condition simplification

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    315ab99 View commit details
    Browse the repository at this point in the history

  55. upd gitignore

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    5240a6c View commit details
    Browse the repository at this point in the history

  56. lint fixes

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    9a770e0 View commit details
    Browse the repository at this point in the history

  57. typings

    @IIaKyJIuH @aPovidlo
    IIaKyJIuH authored and aPovidlo committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    8c793bb View commit details
    Browse the repository at this point in the history

Commits on Nov 27, 2023

  1. Adding preprocessing data at once from API

    @aPovidlo
    aPovidlo committed Nov 27, 2023
    Configuration menu
    Copy the full SHA
    ac1a577 View commit details
    Browse the repository at this point in the history

  2. Fixes in params, data preprocessor merging and fixes in tests

    @aPovidlo
    aPovidlo committed Nov 27, 2023
    Configuration menu
    Copy the full SHA
    3084851 View commit details
    Browse the repository at this point in the history

Commits on Nov 28, 2023

  1. Fixes for MultiModalData

    @aPovidlo
    aPovidlo committed Nov 28, 2023
    Configuration menu
    Copy the full SHA
    adaf590 View commit details
    Browse the repository at this point in the history

  2. Added new api param, fix in merge, fixes & editing tests

    @aPovidlo
    aPovidlo committed Nov 28, 2023
    Configuration menu
    Copy the full SHA
    097c163 View commit details
    Browse the repository at this point in the history

Commits on Nov 29, 2023

  1. Fix param for test

    @aPovidlo
    aPovidlo committed Nov 29, 2023
    Configuration menu
    Copy the full SHA
    94b6af5 View commit details
    Browse the repository at this point in the history

  2. Fix bug in API

    @aPovidlo
    aPovidlo committed Nov 29, 2023
    Configuration menu
    Copy the full SHA
    be007cb View commit details
    Browse the repository at this point in the history

Commits on Dec 5, 2023

  1. @kasyanovse requested improvements

    @aPovidlo
    aPovidlo committed Dec 5, 2023
    Configuration menu
    Copy the full SHA
    8e046f5 View commit details
    Browse the repository at this point in the history

  2. Return fixes

    @aPovidlo
    aPovidlo committed Dec 5, 2023
    Configuration menu
    Copy the full SHA
    cac26f6 View commit details
    Browse the repository at this point in the history

Commits on Dec 6, 2023

  1. Return fixes (1)

    @aPovidlo
    aPovidlo committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    5f62ef4 View commit details
    Browse the repository at this point in the history

Commits on Dec 7, 2023

  1. Remove transformations to str categories

    @aPovidlo
    aPovidlo committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    b962148 View commit details
    Browse the repository at this point in the history

  2. Return transformations to str for categories

    @aPovidlo
    aPovidlo committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    d5b0648 View commit details
    Browse the repository at this point in the history

  3. Fix control_categorical for label encoder

    @aPovidlo
    aPovidlo committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    8be836e View commit details
    Browse the repository at this point in the history

  4. Fix log message

    @aPovidlo
    aPovidlo committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    a91c9ba View commit details
    Browse the repository at this point in the history

Commits on Dec 8, 2023

  1. Small fixes with merger

    @aPovidlo
    aPovidlo committed Dec 8, 2023
    Configuration menu
    Copy the full SHA
    304e29f View commit details
    Browse the repository at this point in the history

Commits on Dec 11, 2023

  1. @andreygetmanov requested fixes

    @aPovidlo
    aPovidlo committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    0c48f7f View commit details
    Browse the repository at this point in the history