Skip to content

Latest commit

 

History

History
189 lines (125 loc) · 7.83 KB

NEWS.0.md

File metadata and controls

189 lines (125 loc) · 7.83 KB
Raw

Old NEWS (pre-v0.5.0, the package name was rpolars)

rpolars v0.4.7

What's changed

  • Revamped docs that includes a new introductory vignette (#81 @grantmcdermott)
  • Misc documentation improvements

rpolars v0.4.6

Release date: 2023-03-13. Full changelog: v0.4.5...v0.4.6

What's new

  • Almost all Expr translated, only missing 'binary'-expr now. #52 #53
  • Run polars queries in detached background threads, no need for any parallel libraries or cluster config #56 #59
  • Full support for when-then-otherwise-syntax #65
  • rpolars now uses bit64 integer64 vectors as input/output for i64 vectors: #68 #69
  • use pl$from_arrow to zero-copy(almost) import Table/Array from r-arrow. #67
  • Support inter process connections with scan_ipc
  • Implement scan_ipc by @Sicheng-Pan in #63
  • 'Backend' improvements
    • (prepare support for aarch64-linux) Touch libgcc_eh.a by @yutannihilation in #49
    • Use py-polars rust file structure (to help devs) by @sorhawell in #55
    • Refactor Makefiles by @eitsupi in #58
    • Build rpolars from Nix by @Sicheng-Pan in #54
    • extendr_api 0.4 by @sorhawell in #6
    • Add r-universe URL by @jeroen in #71
    • chore: install nanoarrow from cran by @eitsupi in #72
    • chore: install nanoarrow from cran (#72) by @sorhawell in #73
    • Fix pdf latex errors by @sorhawell in #74
    • re-enable devel test, pak R-devel issue went away by @sorhawell in #75
    • DO NOT MERGE: tracking hello_r_universe branch by @eitsupi in #38
    • revert to nightly by @sorhawell in #78

New Contributors

  • @Sicheng-Pan made their first contribution in #54
  • @jeroen made their first contribution in #71

rpolars v0.4.5

Release date: 2023-02-21. Full Changelog: v0.4.3...v0.4.5

What's Changed

  • bump rust polars to latest rust-polars and fix all errors by @sorhawell in #42

  • Customize extendr to better support cross Rust-R/R-Rust error handling

    • bump extendr_api by @sorhawell in #44
    • Str even more by @sorhawell in #47

  • rpolars is now available for install from rpolars.r-universe.dev @eitsupi

    • advertise R-universe by @sorhawell in #39
    • Includes reasonably easy pre-compiled installation for arm64-MacBooks

  • All string Expressions available

    • Expr str strptime by @sorhawell in #40
    • rust_result tests + fixes by @sorhawell in #41
    • Str continued by @sorhawell in #43
    • Str even more by @sorhawell in #47

  • Starting to roll out new error-handling and type-conversions between R and rust.

    • Precise source of error should be very clear even in a long method-chain e.g.
    pl$lit("hey-you-there")$str$splitn("-",-3)$alias("struct_of_words")$to_r()
> Error: in str$splitn the arg [n] the value -3 cannot be less than zero
when calling :
pl$lit("hey-you-there")$str$splitn("-", -3)

  • Misc

    • Clippy + tiny optimization by @sorhawell in #45
    • Tidying by @sorhawell in #37

rpolars v0.4.3

Release date: 2023-02-01. Full Changelog: v0.4.2...v0.4.3

What's Changed

  • All DateTime expresssions implemented + update rust-polars to latest commit.
    • Arr str by @sorhawell in #32
    • Datetime continued by @sorhawell in #33
    • Datatime remaining tests + tidy util functions by @sorhawell in #36

Developer changes

  • Refactoring GitHub Actions workflows by @eitsupi in #24
  • Fix cache and check scan by @sorhawell in #30

rpolars v0.4.2

Release date: 2023-01-17. Full Changelog: V0.4.1...v0.4.2

What's Changed

  • fix minor Series syntax issue #8 @sorhawell in #22
  • nanoarrow followup: docs + adjust test by @sorhawell in #21
  • Add R CMD check workflow by @eitsupi in #23
  • usethis::use_mit_license() by @yutannihilation in #27
  • Fix check errors by @sorhawell in #26

New Contributors

  • @eitsupi made their first contribution in #23
  • @yutannihilation made their first contribution in #27

rpolars v0.4.1

Release date: 2023-01-12. Full Changelog: v0.4.0...V0.4.1

What's Changed

  • Export ArrowArrayStream from polars data frame by @paleolimbot in #5
  • Minor arithmetics syntax improvement @sorhawell in #20

Dev env

  • Renv is deactivated as default. Renv.lock still defines package stack on build server @sorhawell in #19

Minor stuff

  • Improve docs by @sorhawell in #16
  • Update rust polars to +26.1 by @sorhawell in #18

New Contributors

  • @paleolimbot made their first contribution in #5

rpolars v0.4.0

Release date: 2023-01-11. Full Changelog: v0.3.1...v0.4.0

Breaking changes

  • Class label "DataType" is now called "RPolarsDataType". Syntax wise 'DataType' can still be used, e.g. .pr$DataType$
  • try fix name space collision with arrow by @sorhawell in #15

New features

  • all list Expr$arr$list functions have been translated:
  • Expr list 2.0 by @sorhawell in #10
  • Expr list 3.0 by @sorhawell in #12

Dev environment

  • update rextendr by @sorhawell in #13

rpolars v0.3.1

Release date: 2023-01-07. Full Changelog: v0.3.0...v0.3.1

What's Changed

  • drop github action upload pre-release of PR's by @sorhawell in #7
  • Fix readme typo by @erjanmx in #6
  • Expr arr list functions + rework r_to_series by @sorhawell in #2

New Contributors

  • @erjanmx made their first contribution in #6

rpolars v0.3.0

Release date: 2022-12-31. Full Changelog: v0.2.1...v0.3.0

What's Changed

  • use jemalloc(linux) else mimallac as py-polars by @sorhawell in #1
  • Bump rust polars 26.1 by @sorhawell in #3
  • Expr_interpolate now has two methods, linear, nearest
  • Expr_quantile also takes quantile value as an expression
  • map_alias improved error handling

rpolars v0.2.1

Release date: 2022-12-27

pre-v0.2.0

  • update 24th November: minipolars is getting bigger and is changing name to rpolars and is hosted on github.com/rpolars/rpolars. Translation, testing and documenting progress is unfortunately not fast enough to finish in 2022. Goal postponed to March 2023. rlang is dropped as install dependency. No dependencies should make it very easy to install and manage versions long term.

  • update 10th November 2022: Full support for Windows, see installation section. After digging through gnu ld linker documentation and R source code idiosyncrasies, rpolars, can now be build for windows (nighly-gnu). In the end adding this super simple linker export definition file prevented the linker from trying to export all +160_000 internal variables into a 16bit symbol table maxing out at 65000 variables. Many thanks for 24-hour support from extendr-team.

  • update 4th November 2022: Latest documentation shows half (125) of all expression functions are now ported. Automatic binary release for Mac and Linux. Windows still pending. It is now very easy to install rpolars from binary. See install section.

  • update: 5th October 2022 Currently ~20% of features have been translated. To make polars call R multi-threaded was a really hard nut to crack as R has no Global-interpreter-lock feature. My solution is to have a main thread in charge of R calls, and any abitrary polars child threads can request to have R user functions executed. Implemented with flume mpsc channels. No serious obstacles left known to me. Just a a lot of writing. Preliminary performance benchmarking promise rpolars is going to perform just as fast pypolars.