support CSV

[friendlymatthew]

fixes #4

What this PR does

• Adds the --jsonl or -csv flags to the CLI.
• NewIndexFile and extends Synchronize for the csv datahandler
• Refactor ReadIndexFile to handle various formats
• Add tests to check byte-identical, checksums between csv Index file <---> csv readIndexFile
• Add tests to check byte-identical between csv Index file <---> jsonl Index file

[kevmo314]

This is a pretty good start. One idea for a test would be to generate the index file and check if it's byte-identical to the index file created by the jsonl version.

Since the taxicab data is relatively primitive types, this should be not too crazy to do.

[friendlymatthew]

This is a pretty good start. One idea for a test would be to generate the index file and check if it's byte-identical to the index file created by the jsonl version.

Since the taxicab data is relatively primitive types, this should be not too crazy to do.

Hey Kevin,

Sorry about the AWOLness, I've been pretty sick with the flu for the past week. I'm slowly feeling better and will have this feature up soon.

Happy new year 🐉 :)

[kevmo314]

No worries, it's the holidays anyways so everything is on higher latency. I also got sick with covid + a cold a two weeks ago so I know how it is, it seems like everyone has been getting sick :)

Happy new year!

[kevmo314]

Nice work on the tests, makes it super easy to figure out.