Optimize stored data

[paulschreiber]

Description

Currently, we are storing CSV and JSON directly in the database.

landpks_soil_model

+----------------------+-----------------+------+-----+---------+----------------+
| Field                | Type            | Null | Key | Default | Extra          |
+----------------------+-----------------+------+-----+---------+----------------+
| ID                   | bigint unsigned | NO   | PRI | NULL    | auto_increment |
| plot_id              | bigint unsigned | YES  | MUL | 0       |                |
| model_version        | int             | YES  |     | 1       |                |
| result_blob          | mediumtext      | YES  |     | NULL    |                |
| soilIDRank_output_pd | mediumtext      | YES  |     | NULL    |                |
| mucompdata_cond_prob | mediumtext      | YES  |     | NULL    |                |
| soilrank             | mediumtext      | YES  |     | NULL    |                |
+----------------------+-----------------+------+-----+---------+----------------+

• result_blob: JSON
• soilrank: JSON
• soilIDRank_output_pd: CSV
• mucompdata_cond_prob: CSV

Can/should this data be stored in tabular data?

landpks_soilgrids

+----------------+-----------------+------+-----+---------+----------------+
| Field          | Type            | Null | Key | Default | Extra          |
+----------------+-----------------+------+-----+---------+----------------+
| ID             | bigint unsigned | NO   | PRI | NULL    | auto_increment |
| plot_id        | bigint unsigned | YES  | MUL | 0       |                |
|  model_version | int             | YES  |     | 1       |                |
| soilgrids_blob | mediumtext      | YES  |     | NULL    |                |
+----------------+-----------------+------+-----+---------+----------------+