Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[3pt] Aggregate by huc pyogrid fielderror #1324

Closed
RobHanna-NOAA opened this issue Oct 20, 2024 · 1 comment · Fixed by #1318
Closed

[3pt] Aggregate by huc pyogrid fielderror #1324

RobHanna-NOAA opened this issue Oct 20, 2024 · 1 comment · Fixed by #1318
Assignees
Labels
bug Something isn't working FIM4

Comments

@RobHanna-NOAA
Copy link
Contributor

During the running of aggregate_by_huc processes against hand_4_5_11_1, on screen I was able to see and capture and error (see below). Unfortunately, agg by huc has minimal logging and there is no info on this error other than the random copy / paste I got off the screen. I am moderately sure that I saw it a few times, but not 100% sure. It might have only been once. I think I saw it more than once and not all on HUCs.


Aggregating branch hydrotables
started: 10/17/2024 19:38:05
Running aggregate_by_huc with 40 workers:   0%|                                                | 0/2153 [00:00<?, ?it/s]--------------------------------------
 huc_id 01010011 has an error - outside multi proc
Traceback (most recent call last):
  File "/foss_fim/src/aggregate_by_huc.py", line 291, in agg_function
    bridge_pnts.to_file(bridge_pnts_file, index=False)
  File "/usr/local/lib/python3.10/dist-packages/geopandas/geodataframe.py", line 1536, in to_file
    _to_file(self, filename, driver, schema, index, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/geopandas/io/file.py", line 686, in _to_file
    _to_file_pyogrio(df, filename, driver, schema, crs, mode, metadata, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/geopandas/io/file.py", line 748, in _to_file_pyogrio
    pyogrio.write_dataframe(df, filename, driver=driver, metadata=metadata, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/pyogrio/geopandas.py", line 622, in write_dataframe
    write_arrow(
  File "/usr/local/lib/python3.10/dist-packages/pyogrio/raw.py", line 857, in write_arrow
    ogr_write_arrow(
  File "pyogrio/_io.pyx", line 2594, in pyogrio._io.ogr_write_arrow
  File "pyogrio/_io.pyx", line 2734, in pyogrio._io.create_fields_from_arrow_schema
pyogrio.errors.FieldError: Error while creating field from Arrow for field 1 with name 'name' and type n (Type 'n' for field name is not supported.).
@RobHanna-NOAA RobHanna-NOAA added bug Something isn't working FIM4 labels Oct 20, 2024
@mluck mluck self-assigned this Oct 21, 2024
@mluck
Copy link
Contributor

mluck commented Oct 21, 2024

This is a duplicate of #1319 and has been fixed in #1318.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working FIM4
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants