Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

try to fix airnow files with strange file encodings #895

Merged
merged 32 commits into from
Oct 26, 2023
Merged
Show file tree
Hide file tree
Changes from 27 commits
Commits
Show all changes
32 commits
Select commit Hold shift + click to select a range
3e25dd0
try to fix airnow files with strange file encodings
Aug 14, 2023
4e61e0f
linting
Aug 14, 2023
477eb1a
provide pandas with a valid encoding string for each file to read
Aug 14, 2023
88c4f53
just try a couple of file encodings before determining it
Aug 15, 2023
4c4d492
just try a couple of file encodings before determining it
Aug 15, 2023
ea86802
update test for new version
Aug 15, 2023
aa52bdf
fix to make sure all station ids are strings
Aug 15, 2023
f9959c8
2nd try: fix to make sure all station ids are strings
Aug 15, 2023
8d26b34
try a more RAM saving approach by only reading in var matching lines …
jgriesfeller Aug 23, 2023
7e3d518
WIP: optimise RAM usage
Aug 24, 2023
71668d7
WIP: optimise RAM usage #2
Aug 24, 2023
7a0d763
use preprocessed monthly files for speed
jgriesfeller Aug 25, 2023
8fa9884
add more type definitions to pd.read_csv to avoid reading errors
jgriesfeller Aug 25, 2023
7f60ae9
WIP add error handling
jgriesfeller Aug 28, 2023
da54af5
remove some clutter and add small optimisations
jgriesfeller Aug 28, 2023
2576877
Merge remote-tracking branch 'origin/main-dev' into griesie-fix-890-a…
jgriesfeller Oct 16, 2023
98e0d6e
linting
jgriesfeller Oct 16, 2023
863042f
WIP: fix tests
jgriesfeller Oct 16, 2023
c4ccd22
make testing work
jgriesfeller Oct 17, 2023
79abe4e
remove clutter, remove few double operations
jgriesfeller Oct 17, 2023
9555cf5
remove even more clutter, bump version
jgriesfeller Oct 17, 2023
2b5a08b
remove even more clutter
jgriesfeller Oct 17, 2023
dbc0380
remove even more clutter
jgriesfeller Oct 17, 2023
c02cd0e
remove even more clutter
jgriesfeller Oct 17, 2023
33bd2b9
linting
jgriesfeller Oct 17, 2023
6058118
Merge remote-tracking branch 'origin/main-dev' into griesie-fix-890-a…
Oct 19, 2023
a1acca8
added test to get more coverage
Oct 19, 2023
711e757
Merge remote-tracking branch 'origin/main-dev' into griesie-fix-890-a…
jgriesfeller Oct 25, 2023
664c030
added type hints
jgriesfeller Oct 26, 2023
bc1d37c
Merge remote-tracking branch 'origin/griesie-fix-890-airnow-reader-cr…
jgriesfeller Oct 26, 2023
0974d4b
linting
jgriesfeller Oct 26, 2023
b50be24
Merge remote-tracking branch 'origin/main-dev' into griesie-fix-890-a…
jgriesfeller Oct 26, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading