Skip to content

Patched singer-framework and msgspec serialization for speed

Compare
Choose a tag to compare
@s7clarke10 s7clarke10 released this 09 Jul 04:35
· 1 commit to master since this release
10a830b

Problem

The underlying singer framework has not been patched for a long time and their a faster json serializes which can improve the performance of this tap.

Proposed changes

Pulling in a new fully patched version of pipelinewise-singer-python.

Types of changes

  • Updating to a patched version of pipelinewise-singer-python using msgspec instead of orjson for serialization.
  • Speeding up tap-oracle via the use of new pipelinewise-singer-python library.
  • deprecating support for Python 3.7, and adding support for Python 3.11 and 3.12 via pipelinewise-singer-python.
  • Testing of this change has been documented here : s7clarke10/realit-singer-python#24