New dataloader (#27)

* fix ssoft columns names * all good * fix import ssptools * add aspect_angle_extrema method * add H extrem to phase plot * add possibilities to save plot, add new plots * pep8 requirements * refactoring and backward compatibility with old version of matplotlib for the notebook 2_compare_models.ipynb * merge conflict * New dataloader * Remove old data * Notebook 2 with the new dataloader * Correct typo in Notebook 2 * Dataloader for the notebooks 3, 4, 5 * Taxonomy for model * Data loader for fink_rms notebook --------- Co-authored-by: Roman <[email protected]>
astrolabsoftware · Aug 9, 2023 · e37700d · e37700d
1 parent 005e5fa
commit e37700d
Show file tree

Hide file tree

Showing 12 changed files with 5,829 additions and 3,149 deletions.
diff --git a/README.md b/README.md
@@ -2,5 +2,5 @@
 
 This repository contains:
 - [fink_spins](fink_spins), a library with necessary routines to work with spin orientation of asteroids
-- [data](data/) for various absolute magnitude models
+- [data](data/) for various absolute magnitude models + instruction to generate data for notebooks
 - [notebooks](notebooks) describing different models, and with various examples and validation steps
diff --git a/data/README.md b/data/README.md
@@ -2,14 +2,13 @@
 
 ### ZTF
 
-(to be written: explain how Fink retrieve data, and how information is extracted).
+In order to generate the dataset, you need to run:
 
-(to be written: dataset boundaries 2019/11 to 202306)
+```python
+python fink_spins/generate_data.py --verbose -version 2023.08
+```
 
-The folder `ztf` contains various datasets:
-- `ztf/sso_fink_HG.parquet`: HG model using ZTF only data 
-- `ztf/sso_fink_HG1G2.parquet`: HG1G2 model using ZTF only data
-- `ztf/sso_fink_SHG1G2.parquet`: HG1G2 + spin model using ZTF only data
+This will download the SSOFT for all flavors (SHG1G2, HG1G2, and HG), and build the master table.
 
 ### ZTF x ATLAS
 
@@ -25,3 +24,4 @@ get_bft.sh download the SsODNet.bft parquet file
 |When| What|
 |----|-----|
 |2023/07/04 | Initial dataset from fink-tutorials@spins |
+|2023/08/09 | Dataset from the SSOFT |
diff --git a/data/ztf/sso_fink_HG.parquet b/data/ztf/sso_fink_HG.parquet
diff --git a/data/ztf/sso_fink_HG1G2.parquet b/data/ztf/sso_fink_HG1G2.parquet
diff --git a/data/ztf/sso_fink_SHG1G2.parquet b/data/ztf/sso_fink_SHG1G2.parquet