00_ImportData.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "id": "58948dc0-8051-4aaf-8341-8ebf56965eed",
   "metadata": {},
   "source": [
    "# Import MOD09GA, MODOCGA, MOD11A1 and MYD11A1 Data"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "8c537b54-1716-45a2-9b01-3d2640d93d39",
   "metadata": {},
   "source": [
    "This is the priliminary notebook of a serie of three:\n",
    "- 00_ImportData: imports products from Terra as well as Aqua and merges it into one dataframe\n",
    "- 01_QualitzControl: invalid entries of the data are replaced by NA \n",
    "- 02_MissingData_complete: the NA entries are filled depending on the chosen method can be analysed in \n",
    "- 03_Analysis: The input variables are analysed, the remaining NA values are deleted, further information from the sites is added and machine Learning is used to analyse the data and train a model to allow conclusions about soil moisture based on remotely sensing data\n",
    "\n",
    "#### This notebook contains:\n",
    "- the import of data in different folder structures \n",
    "- the creation of a dataframe containing all relevant information (data/df_lst_and_refl.csv)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "id": "ed9b9fba-010f-41bc-97f7-2e55e747089e",
   "metadata": {},
   "outputs": [],
   "source": [
    "# enables the use of R code in a cell after writing \"%%R making it an cell for R code \n",
    "%load_ext rpy2.ipython   "
   ]
  },
  {
   "cell_type": "markdown",
   "id": "0224d5c5-af44-4699-a324-b6836ef7dc70",
   "metadata": {},
   "source": [
    "Most of the R libraries will only be added in later noteboods, here we only use tidzverse.\n",
    "rbeni and ingestr is not available in CRAN and must be loaded from github repositories:\n",
    "- https://github.com/stineb/rbeni\n",
    "- https://github.com/computationales/ingestr\n",
    "These two packets are actually not used in this code anymore, since everythin gis already downloaded. However should a new download be necessary they can prove to be useful. Rbeni will be used for plots in the analysis part."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "id": "018d8f83-4f2a-4767-aa0d-f55ddbaf4d9e",
   "metadata": {},
   "outputs": [],
   "source": [
    "%%capture\n",
    "%%R \n",
    "# path_rbeni = \"/home/zhud/wsl/MasterThesis/rsvi/data/rbeni-master/\"\n",
    "# path_ingestr = \"/home/zhud/wsl/MasterThesis/rsvi/data/ingestr-master/\""
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "id": "0b643dd0-9c17-4dd5-9800-b2ec2687e0e1",
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "Failed to create bus connection: No such file or directory\n"
     ]
    }
   ],
   "source": [
    "%%capture\n",
    "%%R \n",
    "# set working directory\n",
    "setwd(\"/home/zhud/wsl/MasterThesis/rsvi\")\n",
    "\n",
    "# import R libaries\n",
    "library(tidyverse)              "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "id": "a01a987d-d1c5-4e56-b4ee-9d17785c8f1a",
   "metadata": {},
   "outputs": [],
   "source": [
    "# import libraries in python\n",
    "import pandas as pd\n",
    "import glob\n",
    "import rpy2.robjects as ro                            # allows the use of R code \n",
    "from rpy2.robjects.packages import importr            # making importing R packages possible, i.e.: utils = importr('utils')\n",
    "base = importr('base')\n",
    "from rpy2.robjects import pandas2ri\n",
    "from rpy2.robjects.conversion import localconverter\n",
    "import os.path\n",
    "import csv\n",
    "from pdb import set_trace\n",
    "import add_fluxnet_modis\n",
    "import numpy as np\n",
    "import pyreadr\n",
    "from functools import partial\n",
    "from rpy2.ipython import html\n",
    "html.html_rdataframe=partial(html.html_rdataframe, table_class=\"docutils\")\n",
    "import pandas as pd\n",
    "import rpy2.robjects as ro\n",
    "from rpy2.robjects.packages import importr\n",
    "from rpy2.robjects import pandas2ri\n",
    "from rpy2.robjects.conversion import localconverter"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "029bdc25-51a2-4aa5-b2ef-ac34980cdd9a",
   "metadata": {
    "tags": []
   },
   "source": [
    "### Import data \n",
    "\n",
    "- MOD09GA (band 1 to 7) \n",
    "- MODOCGA (band 8 to 16)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "id": "4f7f1a04-9f3b-44a7-8ecb-af19364f1f70",
   "metadata": {},
   "outputs": [],
   "source": [
    "%%R\n",
    "raw_dir = './data/FLUXNET_MODOCGA_MOD09GA1km_2000_2018'"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "id": "02eb7ecb-8b41-4343-acef-0f207176d2dc",
   "metadata": {
    "scrolled": true,
    "tags": []
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n",
      "Rows: 6826 Columns: 48\n",
      "── Column specification ────────────────────────────────────────────────────────\n",
      "Delimiter: \",\"\n",
      "chr  (6): system_index, igbp_flx, sites_id, x_geo, Var44, Var45\n",
      "dbl (42): YY, MM, DD, QC_500m, QC_b16_1km, QC_b8_15_1km, Range, SensorAzimut...\n",
      "\n",
      "ℹ Use `spec()` to retrieve the full column specification for this data.\n",
      "ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.\n"
     ]
    }
   ],
   "source": [
    "%%R -o data_stacked \n",
    "csv_files = list.files(path = raw_dir, pattern = \"csv$\", full.names = TRUE)\n",
    "data_stacked <- map_dfr(csv_files, read_csv)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "id": "2d799379-98a3-48ee-aab5-2c98b04c8c7c",
   "metadata": {
    "tags": []
   },
   "outputs": [],
   "source": [
    "refl_df = data_stacked[['YY', 'sites_id', 'site_num', 'state_1km',  'MM', 'DD', 'QC_500m', 'QC_b8_15_1km', 'QC_b16_1km', 'sur_refl_b01', 'sur_refl_b02', 'sur_refl_b03', 'sur_refl_b04', 'sur_refl_b05', 'sur_refl_b06', 'sur_refl_b07', 'sur_refl_b16']]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "id": "74878183-4951-4daa-bf5a-878870e5a9c8",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "YY              float64\n",
      "sites_id         object\n",
      "site_num        float64\n",
      "state_1km       float64\n",
      "MM              float64\n",
      "DD              float64\n",
      "QC_500m         float64\n",
      "QC_b8_15_1km    float64\n",
      "QC_b16_1km      float64\n",
      "sur_refl_b01    float64\n",
      "sur_refl_b02    float64\n",
      "sur_refl_b03    float64\n",
      "sur_refl_b04    float64\n",
      "sur_refl_b05    float64\n",
      "sur_refl_b06    float64\n",
      "sur_refl_b07    float64\n",
      "sur_refl_b16    float64\n",
      "dtype: object\n"
     ]
    }
   ],
   "source": [
    "print(refl_df.dtypes)      "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "id": "2b8a73a5-e5a7-4f35-8c1e-28adf13dc96e",
   "metadata": {},
   "outputs": [],
   "source": [
    "refl_df = refl_df.astype({\"YY\": 'int',\n",
    "                \"MM\": 'int',\n",
    "                \"DD\": 'int'})"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "id": "99a173dc-dd4f-4d7f-ad60-b767f9872095",
   "metadata": {},
   "outputs": [],
   "source": [
    "refl_df['id'] = refl_df[\"YY\"].astype(str) + '_' + refl_df[\"MM\"].astype(str).str.zfill(2) + '_' + refl_df[\"DD\"].astype(str).str.zfill(2)\n",
    "refl_df = refl_df.rename(columns={'sites_id':'sites'})\n",
    "refl_df = refl_df.rename(columns={'QC_b8_15_1km':'QC_b8_15_1km_paula'})"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "id": "bc16c69a-53e5-40d6-8062-70691840c663",
   "metadata": {
    "scrolled": true,
    "tags": []
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>YY</th>\n",
       "      <th>sites</th>\n",
       "      <th>site_num</th>\n",
       "      <th>state_1km</th>\n",
       "      <th>MM</th>\n",
       "      <th>DD</th>\n",
       "      <th>QC_500m</th>\n",
       "      <th>QC_b8_15_1km_paula</th>\n",
       "      <th>QC_b16_1km</th>\n",
       "      <th>sur_refl_b01</th>\n",
       "      <th>sur_refl_b02</th>\n",
       "      <th>sur_refl_b03</th>\n",
       "      <th>sur_refl_b04</th>\n",
       "      <th>sur_refl_b05</th>\n",
       "      <th>sur_refl_b06</th>\n",
       "      <th>sur_refl_b07</th>\n",
       "      <th>sur_refl_b16</th>\n",
       "      <th>id</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2000</td>\n",
       "      <td>AR-SLu</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1033.0</td>\n",
       "      <td>2</td>\n",
       "      <td>24</td>\n",
       "      <td>1.073742e+09</td>\n",
       "      <td>3.722305e+09</td>\n",
       "      <td>208.0</td>\n",
       "      <td>4777.000000</td>\n",
       "      <td>4977.000000</td>\n",
       "      <td>4746.000000</td>\n",
       "      <td>4831.000000</td>\n",
       "      <td>4672.000000</td>\n",
       "      <td>2809.000000</td>\n",
       "      <td>1678.000000</td>\n",
       "      <td>-100.0</td>\n",
       "      <td>2000_02_24</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2000</td>\n",
       "      <td>AR-SLu</td>\n",
       "      <td>1.0</td>\n",
       "      <td>72.0</td>\n",
       "      <td>2</td>\n",
       "      <td>25</td>\n",
       "      <td>1.073742e+09</td>\n",
       "      <td>3.707765e+09</td>\n",
       "      <td>208.0</td>\n",
       "      <td>798.750001</td>\n",
       "      <td>2284.250001</td>\n",
       "      <td>428.000001</td>\n",
       "      <td>759.000001</td>\n",
       "      <td>2677.750001</td>\n",
       "      <td>2368.250000</td>\n",
       "      <td>1441.000000</td>\n",
       "      <td>-100.0</td>\n",
       "      <td>2000_02_25</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>2000</td>\n",
       "      <td>AR-SLu</td>\n",
       "      <td>1.0</td>\n",
       "      <td>1033.0</td>\n",
       "      <td>2</td>\n",
       "      <td>26</td>\n",
       "      <td>1.073742e+09</td>\n",
       "      <td>3.722305e+09</td>\n",
       "      <td>208.0</td>\n",
       "      <td>6264.750011</td>\n",
       "      <td>6624.250010</td>\n",
       "      <td>5941.750010</td>\n",
       "      <td>6277.000011</td>\n",
       "      <td>5583.000008</td>\n",
       "      <td>4895.500006</td>\n",
       "      <td>1710.000000</td>\n",
       "      <td>-100.0</td>\n",
       "      <td>2000_02_26</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>2000</td>\n",
       "      <td>AR-SLu</td>\n",
       "      <td>1.0</td>\n",
       "      <td>72.0</td>\n",
       "      <td>2</td>\n",
       "      <td>27</td>\n",
       "      <td>1.075577e+09</td>\n",
       "      <td>3.489661e+09</td>\n",
       "      <td>208.0</td>\n",
       "      <td>658.750000</td>\n",
       "      <td>2321.250000</td>\n",
       "      <td>367.500000</td>\n",
       "      <td>703.250000</td>\n",
       "      <td>3034.250000</td>\n",
       "      <td>2170.750000</td>\n",
       "      <td>1626.250000</td>\n",
       "      <td>-100.0</td>\n",
       "      <td>2000_02_27</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>2000</td>\n",
       "      <td>AR-SLu</td>\n",
       "      <td>1.0</td>\n",
       "      <td>72.0</td>\n",
       "      <td>2</td>\n",
       "      <td>28</td>\n",
       "      <td>1.073742e+09</td>\n",
       "      <td>3.489661e+09</td>\n",
       "      <td>208.0</td>\n",
       "      <td>522.000000</td>\n",
       "      <td>1758.250001</td>\n",
       "      <td>277.750000</td>\n",
       "      <td>525.250000</td>\n",
       "      <td>2130.250001</td>\n",
       "      <td>1775.750000</td>\n",
       "      <td>995.750000</td>\n",
       "      <td>-100.0</td>\n",
       "      <td>2000_02_28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1447108</th>\n",
       "      <td>2018</td>\n",
       "      <td>ZM-Mon</td>\n",
       "      <td>212.0</td>\n",
       "      <td>8328.0</td>\n",
       "      <td>12</td>\n",
       "      <td>27</td>\n",
       "      <td>1.073742e+09</td>\n",
       "      <td>3.503292e+09</td>\n",
       "      <td>208.0</td>\n",
       "      <td>719.000000</td>\n",
       "      <td>2465.250001</td>\n",
       "      <td>388.000000</td>\n",
       "      <td>647.750000</td>\n",
       "      <td>2773.250001</td>\n",
       "      <td>2228.000001</td>\n",
       "      <td>1404.750000</td>\n",
       "      <td>-100.0</td>\n",
       "      <td>2018_12_27</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1447109</th>\n",
       "      <td>2018</td>\n",
       "      <td>ZM-Mon</td>\n",
       "      <td>212.0</td>\n",
       "      <td>1033.0</td>\n",
       "      <td>12</td>\n",
       "      <td>28</td>\n",
       "      <td>1.073742e+09</td>\n",
       "      <td>3.722305e+09</td>\n",
       "      <td>208.0</td>\n",
       "      <td>8137.999997</td>\n",
       "      <td>8374.999998</td>\n",
       "      <td>8046.499997</td>\n",
       "      <td>8047.249997</td>\n",
       "      <td>8202.250003</td>\n",
       "      <td>5512.749999</td>\n",
       "      <td>3411.500003</td>\n",
       "      <td>-100.0</td>\n",
       "      <td>2018_12_28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1447110</th>\n",
       "      <td>2018</td>\n",
       "      <td>ZM-Mon</td>\n",
       "      <td>212.0</td>\n",
       "      <td>1033.0</td>\n",
       "      <td>12</td>\n",
       "      <td>29</td>\n",
       "      <td>1.073742e+09</td>\n",
       "      <td>3.722305e+09</td>\n",
       "      <td>208.0</td>\n",
       "      <td>7362.249999</td>\n",
       "      <td>7297.499999</td>\n",
       "      <td>7450.749999</td>\n",
       "      <td>7412.499999</td>\n",
       "      <td>5657.999996</td>\n",
       "      <td>2049.250000</td>\n",
       "      <td>1126.249999</td>\n",
       "      <td>-100.0</td>\n",
       "      <td>2018_12_29</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1447111</th>\n",
       "      <td>2018</td>\n",
       "      <td>ZM-Mon</td>\n",
       "      <td>212.0</td>\n",
       "      <td>1033.0</td>\n",
       "      <td>12</td>\n",
       "      <td>30</td>\n",
       "      <td>1.073742e+09</td>\n",
       "      <td>3.722305e+09</td>\n",
       "      <td>208.0</td>\n",
       "      <td>3308.000000</td>\n",
       "      <td>4458.000000</td>\n",
       "      <td>3377.000000</td>\n",
       "      <td>3355.000000</td>\n",
       "      <td>4866.000000</td>\n",
       "      <td>3498.000000</td>\n",
       "      <td>2288.000000</td>\n",
       "      <td>-100.0</td>\n",
       "      <td>2018_12_30</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1447112</th>\n",
       "      <td>2018</td>\n",
       "      <td>ZM-Mon</td>\n",
       "      <td>212.0</td>\n",
       "      <td>1545.0</td>\n",
       "      <td>12</td>\n",
       "      <td>31</td>\n",
       "      <td>1.073742e+09</td>\n",
       "      <td>3.721396e+09</td>\n",
       "      <td>208.0</td>\n",
       "      <td>2226.000000</td>\n",
       "      <td>3978.750000</td>\n",
       "      <td>2087.000000</td>\n",
       "      <td>2233.750000</td>\n",
       "      <td>4265.000000</td>\n",
       "      <td>3243.500000</td>\n",
       "      <td>1867.000000</td>\n",
       "      <td>-100.0</td>\n",
       "      <td>2018_12_31</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>1447112 rows × 18 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "           YY   sites  site_num  state_1km  MM  DD       QC_500m  \\\n",
       "1        2000  AR-SLu       1.0     1033.0   2  24  1.073742e+09   \n",
       "2        2000  AR-SLu       1.0       72.0   2  25  1.073742e+09   \n",
       "3        2000  AR-SLu       1.0     1033.0   2  26  1.073742e+09   \n",
       "4        2000  AR-SLu       1.0       72.0   2  27  1.075577e+09   \n",
       "5        2000  AR-SLu       1.0       72.0   2  28  1.073742e+09   \n",
       "...       ...     ...       ...        ...  ..  ..           ...   \n",
       "1447108  2018  ZM-Mon     212.0     8328.0  12  27  1.073742e+09   \n",
       "1447109  2018  ZM-Mon     212.0     1033.0  12  28  1.073742e+09   \n",
       "1447110  2018  ZM-Mon     212.0     1033.0  12  29  1.073742e+09   \n",
       "1447111  2018  ZM-Mon     212.0     1033.0  12  30  1.073742e+09   \n",
       "1447112  2018  ZM-Mon     212.0     1545.0  12  31  1.073742e+09   \n",
       "\n",
       "         QC_b8_15_1km_paula  QC_b16_1km  sur_refl_b01  sur_refl_b02  \\\n",
       "1              3.722305e+09       208.0   4777.000000   4977.000000   \n",
       "2              3.707765e+09       208.0    798.750001   2284.250001   \n",
       "3              3.722305e+09       208.0   6264.750011   6624.250010   \n",
       "4              3.489661e+09       208.0    658.750000   2321.250000   \n",
       "5              3.489661e+09       208.0    522.000000   1758.250001   \n",
       "...                     ...         ...           ...           ...   \n",
       "1447108        3.503292e+09       208.0    719.000000   2465.250001   \n",
       "1447109        3.722305e+09       208.0   8137.999997   8374.999998   \n",
       "1447110        3.722305e+09       208.0   7362.249999   7297.499999   \n",
       "1447111        3.722305e+09       208.0   3308.000000   4458.000000   \n",
       "1447112        3.721396e+09       208.0   2226.000000   3978.750000   \n",
       "\n",
       "         sur_refl_b03  sur_refl_b04  sur_refl_b05  sur_refl_b06  sur_refl_b07  \\\n",
       "1         4746.000000   4831.000000   4672.000000   2809.000000   1678.000000   \n",
       "2          428.000001    759.000001   2677.750001   2368.250000   1441.000000   \n",
       "3         5941.750010   6277.000011   5583.000008   4895.500006   1710.000000   \n",
       "4          367.500000    703.250000   3034.250000   2170.750000   1626.250000   \n",
       "5          277.750000    525.250000   2130.250001   1775.750000    995.750000   \n",
       "...               ...           ...           ...           ...           ...   \n",
       "1447108    388.000000    647.750000   2773.250001   2228.000001   1404.750000   \n",
       "1447109   8046.499997   8047.249997   8202.250003   5512.749999   3411.500003   \n",
       "1447110   7450.749999   7412.499999   5657.999996   2049.250000   1126.249999   \n",
       "1447111   3377.000000   3355.000000   4866.000000   3498.000000   2288.000000   \n",
       "1447112   2087.000000   2233.750000   4265.000000   3243.500000   1867.000000   \n",
       "\n",
       "         sur_refl_b16          id  \n",
       "1              -100.0  2000_02_24  \n",
       "2              -100.0  2000_02_25  \n",
       "3              -100.0  2000_02_26  \n",
       "4              -100.0  2000_02_27  \n",
       "5              -100.0  2000_02_28  \n",
       "...               ...         ...  \n",
       "1447108        -100.0  2018_12_27  \n",
       "1447109        -100.0  2018_12_28  \n",
       "1447110        -100.0  2018_12_29  \n",
       "1447111        -100.0  2018_12_30  \n",
       "1447112        -100.0  2018_12_31  \n",
       "\n",
       "[1447112 rows x 18 columns]"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "refl_df"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "f5031d2e-6d1c-4991-8f75-8d8a3b9f8e4c",
   "metadata": {},
   "source": [
    "### Import data \n",
    "- MODOCGA (band 8 to 15)\n",
    "- MOD11A1 (modis_lst_terra)\n",
    "- MYD11A1 (modis_lst_aqua)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "id": "560b11a1-43ee-493f-8a60-573ffc4dcaa4",
   "metadata": {},
   "outputs": [],
   "source": [
    "%%R -o rsd \n",
    "# reads in the .rda file and exports it to python\n",
    "rsd <- readRDS('./data/remote_sensing_data.rda')\n",
    "\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "id": "2c28b2da-ad76-4e0e-a09b-0138f76987d0",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " [1] \"modis_lst_terra\" \"modis_lst_aqua\"  \"modis_refl_1\"    \"modis_refl_2\"   \n",
      " [5] \"modis_refl_3\"    \"modis_refl_4\"    \"modis_refl_5\"    \"modis_refl_6\"   \n",
      " [9] \"modis_refl_7\"    \"modis_refl_8\"    \"modis_refl_9\"    \"modis_refl_10\"  \n",
      "[13] \"modis_refl_11\"   \"modis_refl_12\"   \"modis_refl_13\"   \"modis_refl_14\"  \n",
      "[17] \"modis_refl_15\"  \n"
     ]
    }
   ],
   "source": [
    "%%R -o names_data\n",
    "names_data <- names(rsd)\n",
    "names_data"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "1a1e7555-a130-4a42-a2d3-d303b4447907",
   "metadata": {},
   "source": [
    "### Read in all the data for each source in names_data"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "id": "8fa5683b-e793-4f8c-90b2-1c8e4be64de6",
   "metadata": {},
   "outputs": [],
   "source": [
    "def flatten_df(data, product_number):\n",
    "    '''\n",
    "    data            nested data with product at the first level\n",
    "                    at the second level there is the sites \n",
    "                    for each product a dataframe (df) is available\n",
    "    product_number  give a number from which the df should be returned from\n",
    "    return df       dataframe for the requested product_number and all sites.\n",
    "                    The name of the sites are saved in a column called 'sites'    \n",
    "    '''\n",
    "    df = pd.DataFrame()\n",
    "    sites = data[product_number][0]\n",
    "    data_vector = data[product_number][1]\n",
    "    for j in range(len(sites)):\n",
    "        site = sites[j]\n",
    "        # convert data_vector[j] into an pd df and append it and add a column with the site\n",
    "        with localconverter(ro.default_converter + pandas2ri.converter):\n",
    "            data = ro.conversion.rpy2py(data_vector[j])\n",
    "        data['sites'] = site\n",
    "        df = df.append(data)\n",
    "    return df"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "id": "d27d7181-6849-477a-b6da-54cd2d460804",
   "metadata": {},
   "outputs": [],
   "source": [
    "# read in all products\n",
    "modis_lst_terra = flatten_df(rsd, 0) # MOD11A1\n",
    "modis_lst_aqua = flatten_df(rsd, 1)  # MYD11A1\n",
    "modis_refl_8 = flatten_df(rsd, 9)    # MODOCGA\n",
    "modis_refl_9 = flatten_df(rsd, 10)\n",
    "modis_refl_10 = flatten_df(rsd, 11)\n",
    "modis_refl_11 = flatten_df(rsd, 12)\n",
    "modis_refl_12 = flatten_df(rsd, 13)\n",
    "modis_refl_13 = flatten_df(rsd, 14)\n",
    "modis_refl_14 = flatten_df(rsd, 15)\n",
    "modis_refl_15 = flatten_df(rsd, 16)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "id": "44e8295d-0945-4089-99aa-05b78083b6f8",
   "metadata": {},
   "outputs": [],
   "source": [
    "# rename columns with same name\n",
    "modis_lst_terra_newname = modis_lst_terra.rename(columns={'LST_Day_1km':'LST_Day_1km_terra','QC_Day':'QC_Day_terra'})\n",
    "modis_lst_aqua_newname = modis_lst_aqua.rename(columns={'LST_Day_1km':'LST_Day_1km_aqua','QC_Day':'QC_Day_aqua'})"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "id": "f5cf3508-6068-44cc-b031-cf1af72b85ed",
   "metadata": {},
   "outputs": [],
   "source": [
    "# combine lst_terra (MOD11A1) and lst_aqua (MYD11A1) in one ddf\n",
    "ddf = modis_lst_terra_newname.merge(modis_lst_aqua_newname[['date', 'year_dec', 'sites',\t'LST_Day_1km_aqua', 'QC_Day_aqua']], on=[\"date\", \"sites\"])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "id": "70a3fa02-eaf2-4cf1-8d99-64092fbdaae0",
   "metadata": {
    "scrolled": true,
    "tags": []
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "      date         year_dec_x        id            LST_Day_1km_terra\n",
      " Min.   : 7670   Min.   :1991   Length:265177      Min.   :234.2    \n",
      " 1st Qu.:12464   1st Qu.:2004   Class :character   1st Qu.:284.3    \n",
      " Median :13919   Median :2008   Mode  :character   Median :293.6    \n",
      " Mean   :13696   Mean   :2007                      Mean   :292.5    \n",
      " 3rd Qu.:15151   3rd Qu.:2011                      3rd Qu.:301.7    \n",
      " Max.   :16435   Max.   :2015                      Max.   :330.6    \n",
      "                                                   NA's   :162614   \n",
      "  QC_Day_terra       sites             year_dec_y   LST_Day_1km_aqua\n",
      " Min.   :  0.00   Length:265177      Min.   :1991   Min.   :233.9   \n",
      " 1st Qu.:  2.00   Class :character   1st Qu.:2004   1st Qu.:286.1   \n",
      " Median :  2.00   Mode  :character   Median :2008   Median :295.0   \n",
      " Mean   : 12.91                      Mean   :2007   Mean   :294.9   \n",
      " 3rd Qu.:  2.00                      3rd Qu.:2011   3rd Qu.:304.3   \n",
      " Max.   :145.00                      Max.   :2015   Max.   :337.1   \n",
      " NA's   :23428                                      NA's   :176474  \n",
      "  QC_Day_aqua    \n",
      " Min.   :  0.00  \n",
      " 1st Qu.:  2.00  \n",
      " Median :  2.00  \n",
      " Mean   : 14.36  \n",
      " 3rd Qu.:  2.00  \n",
      " Max.   :145.00  \n",
      " NA's   :45571   \n"
     ]
    }
   ],
   "source": [
    "%%R -i ddf\n",
    "summary(ddf)   \n",
    "# rows 265177\n",
    "# time 1991 - 2015 (aqua and terra were only in the early 2000s launched, however there is little old data and it will be sorted out)\n",
    "# NA lst_terra  162614\n",
    "#    lst_aqua   176474"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "id": "8c795950-1b29-42d0-8002-0b37387008a4",
   "metadata": {
    "scrolled": true,
    "tags": []
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>date</th>\n",
       "      <th>year_dec_x</th>\n",
       "      <th>id</th>\n",
       "      <th>LST_Day_1km_terra</th>\n",
       "      <th>QC_Day_terra</th>\n",
       "      <th>sites</th>\n",
       "      <th>year_dec_y</th>\n",
       "      <th>LST_Day_1km_aqua</th>\n",
       "      <th>QC_Day_aqua</th>\n",
       "      <th>sur_refl_b08</th>\n",
       "      <th>sur_refl_b09</th>\n",
       "      <th>sur_refl_b10</th>\n",
       "      <th>sur_refl_b11</th>\n",
       "      <th>sur_refl_b12</th>\n",
       "      <th>sur_refl_b13</th>\n",
       "      <th>sur_refl_b14</th>\n",
       "      <th>sur_refl_b15</th>\n",
       "      <th>QC_b8_15_1km</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>14245.0</td>\n",
       "      <td>2009.000000</td>\n",
       "      <td>2009_01_01</td>\n",
       "      <td>307.22</td>\n",
       "      <td>65.0</td>\n",
       "      <td>AR-Vir</td>\n",
       "      <td>2009.000000</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2.0</td>\n",
       "      <td>0.0174</td>\n",
       "      <td>0.0300</td>\n",
       "      <td>0.0383</td>\n",
       "      <td>0.0666</td>\n",
       "      <td>0.0775</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.010</td>\n",
       "      <td>-0.01</td>\n",
       "      <td>3.721396e+09</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>14246.0</td>\n",
       "      <td>2009.002740</td>\n",
       "      <td>2009_01_02</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2.0</td>\n",
       "      <td>AR-Vir</td>\n",
       "      <td>2009.002740</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2.0</td>\n",
       "      <td>0.4738</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.010</td>\n",
       "      <td>-0.01</td>\n",
       "      <td>3.722305e+09</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>14247.0</td>\n",
       "      <td>2009.005479</td>\n",
       "      <td>2009_01_03</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2.0</td>\n",
       "      <td>AR-Vir</td>\n",
       "      <td>2009.005479</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2.0</td>\n",
       "      <td>0.3668</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.010</td>\n",
       "      <td>-0.01</td>\n",
       "      <td>3.722305e+09</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>14248.0</td>\n",
       "      <td>2009.008219</td>\n",
       "      <td>2009_01_04</td>\n",
       "      <td>303.32</td>\n",
       "      <td>65.0</td>\n",
       "      <td>AR-Vir</td>\n",
       "      <td>2009.008219</td>\n",
       "      <td>306.48</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.2286</td>\n",
       "      <td>0.2401</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.010</td>\n",
       "      <td>-0.01</td>\n",
       "      <td>3.722305e+09</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>14249.0</td>\n",
       "      <td>2009.010959</td>\n",
       "      <td>2009_01_05</td>\n",
       "      <td>307.22</td>\n",
       "      <td>0.0</td>\n",
       "      <td>AR-Vir</td>\n",
       "      <td>2009.010959</td>\n",
       "      <td>309.16</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0098</td>\n",
       "      <td>0.0150</td>\n",
       "      <td>0.0160</td>\n",
       "      <td>0.0288</td>\n",
       "      <td>0.0334</td>\n",
       "      <td>0.0271</td>\n",
       "      <td>0.027</td>\n",
       "      <td>-0.01</td>\n",
       "      <td>3.489661e+09</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>265172</th>\n",
       "      <td>14605.0</td>\n",
       "      <td>2009.986301</td>\n",
       "      <td>2009_12_27</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2.0</td>\n",
       "      <td>ZM-Mon</td>\n",
       "      <td>2009.986301</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2.0</td>\n",
       "      <td>0.2668</td>\n",
       "      <td>0.2599</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.010</td>\n",
       "      <td>-0.01</td>\n",
       "      <td>3.722305e+09</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>265173</th>\n",
       "      <td>14606.0</td>\n",
       "      <td>2009.989041</td>\n",
       "      <td>2009_12_28</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2.0</td>\n",
       "      <td>ZM-Mon</td>\n",
       "      <td>2009.989041</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2.0</td>\n",
       "      <td>0.1632</td>\n",
       "      <td>0.1658</td>\n",
       "      <td>0.1622</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.010</td>\n",
       "      <td>-0.01</td>\n",
       "      <td>3.722301e+09</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>265174</th>\n",
       "      <td>14607.0</td>\n",
       "      <td>2009.991781</td>\n",
       "      <td>2009_12_29</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2.0</td>\n",
       "      <td>ZM-Mon</td>\n",
       "      <td>2009.991781</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2.0</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.010</td>\n",
       "      <td>-0.01</td>\n",
       "      <td>3.722305e+09</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>265175</th>\n",
       "      <td>14608.0</td>\n",
       "      <td>2009.994521</td>\n",
       "      <td>2009_12_30</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2.0</td>\n",
       "      <td>ZM-Mon</td>\n",
       "      <td>2009.994521</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2.0</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.010</td>\n",
       "      <td>-0.01</td>\n",
       "      <td>3.722305e+09</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>265176</th>\n",
       "      <td>14609.0</td>\n",
       "      <td>2009.997260</td>\n",
       "      <td>2009_12_31</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2.0</td>\n",
       "      <td>ZM-Mon</td>\n",
       "      <td>2009.997260</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2.0</td>\n",
       "      <td>0.2143</td>\n",
       "      <td>0.2098</td>\n",
       "      <td>0.2051</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.0100</td>\n",
       "      <td>-0.010</td>\n",
       "      <td>-0.01</td>\n",
       "      <td>3.722301e+09</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>265177 rows × 18 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "           date   year_dec_x          id  LST_Day_1km_terra  QC_Day_terra  \\\n",
       "0       14245.0  2009.000000  2009_01_01             307.22          65.0   \n",
       "1       14246.0  2009.002740  2009_01_02                NaN           2.0   \n",
       "2       14247.0  2009.005479  2009_01_03                NaN           2.0   \n",
       "3       14248.0  2009.008219  2009_01_04             303.32          65.0   \n",
       "4       14249.0  2009.010959  2009_01_05             307.22           0.0   \n",
       "...         ...          ...         ...                ...           ...   \n",
       "265172  14605.0  2009.986301  2009_12_27                NaN           2.0   \n",
       "265173  14606.0  2009.989041  2009_12_28                NaN           2.0   \n",
       "265174  14607.0  2009.991781  2009_12_29                NaN           2.0   \n",
       "265175  14608.0  2009.994521  2009_12_30                NaN           2.0   \n",
       "265176  14609.0  2009.997260  2009_12_31                NaN           2.0   \n",
       "\n",
       "         sites   year_dec_y  LST_Day_1km_aqua  QC_Day_aqua  sur_refl_b08  \\\n",
       "0       AR-Vir  2009.000000               NaN          2.0        0.0174   \n",
       "1       AR-Vir  2009.002740               NaN          2.0        0.4738   \n",
       "2       AR-Vir  2009.005479               NaN          2.0        0.3668   \n",
       "3       AR-Vir  2009.008219            306.48          0.0        0.2286   \n",
       "4       AR-Vir  2009.010959            309.16          0.0        0.0098   \n",
       "...        ...          ...               ...          ...           ...   \n",
       "265172  ZM-Mon  2009.986301               NaN          2.0        0.2668   \n",
       "265173  ZM-Mon  2009.989041               NaN          2.0        0.1632   \n",
       "265174  ZM-Mon  2009.991781               NaN          2.0       -0.0100   \n",
       "265175  ZM-Mon  2009.994521               NaN          2.0       -0.0100   \n",
       "265176  ZM-Mon  2009.997260               NaN          2.0        0.2143   \n",
       "\n",
       "        sur_refl_b09  sur_refl_b10  sur_refl_b11  sur_refl_b12  sur_refl_b13  \\\n",
       "0             0.0300        0.0383        0.0666        0.0775       -0.0100   \n",
       "1            -0.0100       -0.0100       -0.0100       -0.0100       -0.0100   \n",
       "2            -0.0100       -0.0100       -0.0100       -0.0100       -0.0100   \n",
       "3             0.2401       -0.0100       -0.0100       -0.0100       -0.0100   \n",
       "4             0.0150        0.0160        0.0288        0.0334        0.0271   \n",
       "...              ...           ...           ...           ...           ...   \n",
       "265172        0.2599       -0.0100       -0.0100       -0.0100       -0.0100   \n",
       "265173        0.1658        0.1622       -0.0100       -0.0100       -0.0100   \n",
       "265174       -0.0100       -0.0100       -0.0100       -0.0100       -0.0100   \n",
       "265175       -0.0100       -0.0100       -0.0100       -0.0100       -0.0100   \n",
       "265176        0.2098        0.2051       -0.0100       -0.0100       -0.0100   \n",
       "\n",
       "        sur_refl_b14  sur_refl_b15  QC_b8_15_1km  \n",
       "0             -0.010         -0.01  3.721396e+09  \n",
       "1             -0.010         -0.01  3.722305e+09  \n",
       "2             -0.010         -0.01  3.722305e+09  \n",
       "3             -0.010         -0.01  3.722305e+09  \n",
       "4              0.027         -0.01  3.489661e+09  \n",
       "...              ...           ...           ...  \n",
       "265172        -0.010         -0.01  3.722305e+09  \n",
       "265173        -0.010         -0.01  3.722301e+09  \n",
       "265174        -0.010         -0.01  3.722305e+09  \n",
       "265175        -0.010         -0.01  3.722305e+09  \n",
       "265176        -0.010         -0.01  3.722301e+09  \n",
       "\n",
       "[265177 rows x 18 columns]"
      ]
     },
     "execution_count": 19,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# combine MODOCGA (band 8 to 15) with ddf containing already the lst data 177309 rows\n",
    "# !!!!!!!!!!!!!!! merging on year_dec loses about 1/3 of the data! \n",
    "# it is calculated differently and when merging there is a slight numeric difference. \n",
    "ddf = ddf.merge(modis_refl_8[['date', 'sites', 'sur_refl_b08']], on=[\"date\", \"sites\"])\n",
    "ddf = ddf.merge(modis_refl_9[['date', 'sites', 'sur_refl_b09']], on=[\"date\", \"sites\"])\n",
    "ddf = ddf.merge(modis_refl_10[['date', 'sites', 'sur_refl_b10']], on=[\"date\", \"sites\"])\n",
    "ddf = ddf.merge(modis_refl_11[['date', 'sites', 'sur_refl_b11']], on=[\"date\", \"sites\"])\n",
    "ddf = ddf.merge(modis_refl_12[['date', 'sites', 'sur_refl_b12']], on=[\"date\", \"sites\"])\n",
    "ddf = ddf.merge(modis_refl_13[['date', 'sites', 'sur_refl_b13']], on=[\"date\", \"sites\"])\n",
    "ddf = ddf.merge(modis_refl_14[['date', 'sites', 'sur_refl_b14']], on=[\"date\", \"sites\"])\n",
    "ddf = ddf.merge(modis_refl_15[['date', 'sites', 'sur_refl_b15',\t'QC_b8_15_1km']], on=[\"date\", \"sites\"])\n",
    "ddf"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "id": "325378b1-76f9-4a39-8a98-afb6a397fccc",
   "metadata": {
    "scrolled": true,
    "tags": []
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "      date         year_dec_x        id            LST_Day_1km_terra\n",
      " Min.   : 7670   Min.   :1991   Length:265177      Min.   :234.2    \n",
      " 1st Qu.:12464   1st Qu.:2004   Class :character   1st Qu.:284.3    \n",
      " Median :13919   Median :2008   Mode  :character   Median :293.6    \n",
      " Mean   :13696   Mean   :2007                      Mean   :292.5    \n",
      " 3rd Qu.:15151   3rd Qu.:2011                      3rd Qu.:301.7    \n",
      " Max.   :16435   Max.   :2015                      Max.   :330.6    \n",
      "                                                   NA's   :162614   \n",
      "  QC_Day_terra       sites             year_dec_y   LST_Day_1km_aqua\n",
      " Min.   :  0.00   Length:265177      Min.   :1991   Min.   :233.9   \n",
      " 1st Qu.:  2.00   Class :character   1st Qu.:2004   1st Qu.:286.1   \n",
      " Median :  2.00   Mode  :character   Median :2008   Median :295.0   \n",
      " Mean   : 12.91                      Mean   :2007   Mean   :294.9   \n",
      " 3rd Qu.:  2.00                      3rd Qu.:2011   3rd Qu.:304.3   \n",
      " Max.   :145.00                      Max.   :2015   Max.   :337.1   \n",
      " NA's   :23428                                      NA's   :176474  \n",
      "  QC_Day_aqua      sur_refl_b08     sur_refl_b09     sur_refl_b10   \n",
      " Min.   :  0.00   Min.   :-0.010   Min.   :-0.010   Min.   :-0.010  \n",
      " 1st Qu.:  2.00   1st Qu.: 0.026   1st Qu.: 0.016   1st Qu.:-0.010  \n",
      " Median :  2.00   Median : 0.141   Median : 0.048   Median : 0.032  \n",
      " Mean   : 14.36   Mean   : 0.267   Mean   : 0.175   Mean   : 0.098  \n",
      " 3rd Qu.:  2.00   3rd Qu.: 0.494   3rd Qu.: 0.277   3rd Qu.: 0.106  \n",
      " Max.   :145.00   Max.   : 1.380   Max.   : 1.372   Max.   : 1.282  \n",
      " NA's   :45571    NA's   :28514    NA's   :28514    NA's   :28514   \n",
      "  sur_refl_b11     sur_refl_b12     sur_refl_b13     sur_refl_b14   \n",
      " Min.   :-0.010   Min.   :-0.010   Min.   :-0.010   Min.   :-0.010  \n",
      " 1st Qu.:-0.010   1st Qu.:-0.010   1st Qu.:-0.010   1st Qu.:-0.010  \n",
      " Median : 0.033   Median : 0.027   Median :-0.010   Median :-0.010  \n",
      " Mean   : 0.072   Mean   : 0.060   Mean   : 0.012   Mean   : 0.017  \n",
      " 3rd Qu.: 0.083   3rd Qu.: 0.076   3rd Qu.: 0.023   3rd Qu.: 0.032  \n",
      " Max.   : 1.322   Max.   : 1.406   Max.   : 1.048   Max.   : 1.156  \n",
      " NA's   :28514    NA's   :28514    NA's   :28514    NA's   :28514   \n",
      "  sur_refl_b15    QC_b8_15_1km      \n",
      " Min.   :-0.01   Min.   :0.000e+00  \n",
      " 1st Qu.:-0.01   1st Qu.:3.490e+09  \n",
      " Median :-0.01   Median :3.721e+09  \n",
      " Mean   : 0.00   Mean   :3.436e+09  \n",
      " 3rd Qu.:-0.01   3rd Qu.:3.722e+09  \n",
      " Max.   : 0.91   Max.   :3.722e+09  \n",
      " NA's   :28514   NA's   :28514      \n"
     ]
    }
   ],
   "source": [
    "%%R -i ddf\n",
    "summary(ddf)   \n",
    "# rows 265177 \n",
    "# time 1991 - 2015\n",
    "\n",
    "# !!!!!!!!!!!!!!! merging on year_dec loses about 1/3 of the data! \n",
    "# it is calculated differently and when merging there is a slight numeric difference. \n",
    "# merging on the date solves that\n",
    "\n",
    "# length(unique(ddf$sites))  # 71"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "6c925298-1361-4819-a6db-81bb76fe516f",
   "metadata": {},
   "source": [
    "# Merge reflectance data and land surface temperature"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "id": "23ab721a-15b7-46c8-a472-68eeb74ab512",
   "metadata": {},
   "outputs": [],
   "source": [
    "df_lst_and_refl = ddf.merge(refl_df, on=[\"id\", \"sites\"])"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "48e73f35-71f4-4f7a-92a4-e08efd24fc1e",
   "metadata": {},
   "source": [
    "# Export Data"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "id": "fe4e9b44-50fb-4967-867a-e46cb7a86b3b",
   "metadata": {},
   "outputs": [],
   "source": [
    "df_lst_and_refl.to_csv('./data/df_lst_and_refl.csv', index=False)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "8943d4b9-ab2d-418c-9597-383898216e6c",
   "metadata": {},
   "source": [
    "Carry on with the Quality Control Notebook (02_QualityControl.ipynb)\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "a20e6fc1-0c7b-4a1b-9fa3-e6e95152c32f",
   "metadata": {},
   "source": [
    "# Overview"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "id": "d021a70f-9d3e-445a-8911-d122d02e73c7",
   "metadata": {
    "scrolled": true,
    "tags": []
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "      date         year_dec_x        id            LST_Day_1km_terra\n",
      " Min.   :11011   Min.   :2000   Length:241826      Min.   :234.2    \n",
      " 1st Qu.:12861   1st Qu.:2005   Class :character   1st Qu.:284.3    \n",
      " Median :14126   Median :2009   Mode  :character   Median :293.6    \n",
      " Mean   :14022   Mean   :2008                      Mean   :292.5    \n",
      " 3rd Qu.:15254   3rd Qu.:2012                      3rd Qu.:301.7    \n",
      " Max.   :16434   Max.   :2015                      Max.   :330.6    \n",
      "                                                   NA's   :139323   \n",
      "  QC_Day_terra       sites             year_dec_y   LST_Day_1km_aqua\n",
      " Min.   :  0.00   Length:241826      Min.   :2000   Min.   :233.9   \n",
      " 1st Qu.:  2.00   Class :character   1st Qu.:2005   1st Qu.:286.1   \n",
      " Median :  2.00   Mode  :character   Median :2009   Median :295.1   \n",
      " Mean   : 12.91                      Mean   :2008   Mean   :294.9   \n",
      " 3rd Qu.:  2.00                      3rd Qu.:2012   3rd Qu.:304.4   \n",
      " Max.   :145.00                      Max.   :2015   Max.   :337.1   \n",
      " NA's   :232                                        NA's   :153273  \n",
      "  QC_Day_aqua      sur_refl_b08     sur_refl_b09     sur_refl_b10   \n",
      " Min.   :  0.00   Min.   :-0.010   Min.   :-0.010   Min.   :-0.010  \n",
      " 1st Qu.:  2.00   1st Qu.: 0.026   1st Qu.: 0.016   1st Qu.:-0.010  \n",
      " Median :  2.00   Median : 0.142   Median : 0.048   Median : 0.032  \n",
      " Mean   : 14.37   Mean   : 0.267   Mean   : 0.175   Mean   : 0.098  \n",
      " 3rd Qu.:  2.00   3rd Qu.: 0.495   3rd Qu.: 0.277   3rd Qu.: 0.106  \n",
      " Max.   :145.00   Max.   : 1.380   Max.   : 1.372   Max.   : 1.282  \n",
      " NA's   :22737    NA's   :5209     NA's   :5209     NA's   :5209    \n",
      "  sur_refl_b11     sur_refl_b12     sur_refl_b13     sur_refl_b14   \n",
      " Min.   :-0.010   Min.   :-0.010   Min.   :-0.010   Min.   :-0.010  \n",
      " 1st Qu.:-0.010   1st Qu.:-0.010   1st Qu.:-0.010   1st Qu.:-0.010  \n",
      " Median : 0.033   Median : 0.027   Median :-0.010   Median :-0.010  \n",
      " Mean   : 0.072   Mean   : 0.060   Mean   : 0.012   Mean   : 0.017  \n",
      " 3rd Qu.: 0.083   3rd Qu.: 0.076   3rd Qu.: 0.023   3rd Qu.: 0.032  \n",
      " Max.   : 1.322   Max.   : 1.406   Max.   : 1.048   Max.   : 1.156  \n",
      " NA's   :5209     NA's   :5209     NA's   :5209     NA's   :5209    \n",
      "  sur_refl_b15    QC_b8_15_1km             YY          site_num  \n",
      " Min.   :-0.01   Min.   :0.000e+00   Min.   :2000   Min.   :  2  \n",
      " 1st Qu.:-0.01   1st Qu.:3.490e+09   1st Qu.:2005   1st Qu.: 74  \n",
      " Median :-0.01   Median :3.721e+09   Median :2008   Median :114  \n",
      " Mean   : 0.00   Mean   :3.436e+09   Mean   :2008   Mean   :112  \n",
      " 3rd Qu.:-0.01   3rd Qu.:3.722e+09   3rd Qu.:2011   3rd Qu.:166  \n",
      " Max.   : 0.91   Max.   :3.722e+09   Max.   :2014   Max.   :212  \n",
      " NA's   :5209    NA's   :5209                                    \n",
      "   state_1km           MM               DD           QC_500m         \n",
      " Min.   :    0   Min.   : 1.000   Min.   : 1.00   Min.   :5.995e+08  \n",
      " 1st Qu.:  200   1st Qu.: 4.000   1st Qu.: 8.00   1st Qu.:1.074e+09  \n",
      " Median : 1033   Median : 7.000   Median :16.00   Median :1.074e+09  \n",
      " Mean   : 2904   Mean   : 6.545   Mean   :15.71   Mean   :1.071e+09  \n",
      " 3rd Qu.: 1042   3rd Qu.:10.000   3rd Qu.:23.00   3rd Qu.:1.074e+09  \n",
      " Max.   :45080   Max.   :12.000   Max.   :31.00   Max.   :2.076e+09  \n",
      " NA's   :4873                                     NA's   :4873       \n",
      " QC_b8_15_1km_paula    QC_b16_1km     sur_refl_b01    sur_refl_b02  \n",
      " Min.   :0.000e+00   Min.   :  0.0   Min.   : -100   Min.   : -100  \n",
      " 1st Qu.:3.490e+09   1st Qu.:208.0   1st Qu.:  705   1st Qu.: 2520  \n",
      " Median :3.721e+09   Median :208.0   Median : 2164   Median : 3696  \n",
      " Mean   :3.436e+09   Mean   :192.3   Mean   : 3240   Mean   : 4308  \n",
      " 3rd Qu.:3.722e+09   3rd Qu.:208.0   3rd Qu.: 5642   3rd Qu.: 5962  \n",
      " Max.   :3.722e+09   Max.   :208.0   Max.   :16000   Max.   :16000  \n",
      " NA's   :5704        NA's   :5918    NA's   :4960    NA's   :5399   \n",
      "  sur_refl_b03    sur_refl_b04    sur_refl_b05       sur_refl_b06     \n",
      " Min.   : -100   Min.   : -100   Min.   :  -41.25   Min.   :  -69.25  \n",
      " 1st Qu.:  398   1st Qu.:  702   1st Qu.: 2642.94   1st Qu.: 1672.00  \n",
      " Median : 2002   Median : 2120   Median : 3581.00   Median : 2513.50  \n",
      " Mean   : 3083   Mean   : 3250   Mean   : 4015.78   Mean   : 2837.84  \n",
      " 3rd Qu.: 5641   3rd Qu.: 5686   3rd Qu.: 5390.00   3rd Qu.: 3790.56  \n",
      " Max.   :16000   Max.   :16000   Max.   :15178.50   Max.   :14967.00  \n",
      " NA's   :4966    NA's   :4964    NA's   :5102       NA's   :4982      \n",
      "  sur_refl_b07      sur_refl_b16     \n",
      " Min.   :  -90.5   Min.   : -100.00  \n",
      " 1st Qu.:  805.5   1st Qu.: -100.00  \n",
      " Median : 1462.2   Median : -100.00  \n",
      " Mean   : 1761.1   Mean   :   55.47  \n",
      " 3rd Qu.: 2501.0   3rd Qu.: -100.00  \n",
      " Max.   :16000.0   Max.   :10216.00  \n",
      " NA's   :5032      NA's   :5704      \n"
     ]
    }
   ],
   "source": [
    "%%R -i df_lst_and_refl\n",
    "summary(df_lst_and_refl)\n",
    "# rows 241826                            was 265177 - about 91 %\n",
    "# time 2001 - 2015                       ten years lost due to different timeframes, however at the beginning there is less data \n",
    "#                                        and no landsurface temperature (Aqua and Terra are launched in the early 2000s)\n",
    "#                                        important to transform id with str.zfill(2) otherwise most of the data is lost"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "id": "b08d8638-174c-4c83-bc88-79e827586610",
   "metadata": {},
   "outputs": [],
   "source": [
    "df_lst_and_refl = df_lst_and_refl[[\"sites\", \"year_dec_x\", 'sur_refl_b01', 'sur_refl_b02', 'sur_refl_b03', 'sur_refl_b04', 'sur_refl_b05', 'sur_refl_b06', 'sur_refl_b07',\n",
    "                                 'sur_refl_b08', 'sur_refl_b09', 'sur_refl_b10', \n",
    "                                  'sur_refl_b11', 'sur_refl_b12', 'sur_refl_b13', 'sur_refl_b14']]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "id": "a00940e2-28fc-4dbb-b229-a299c99f72bb",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "235876"
      ]
     },
     "execution_count": 25,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "len(df_lst_and_refl.dropna())"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "id": "b6d3525b-8704-495d-aa70-f6be50700528",
   "metadata": {},
   "outputs": [],
   "source": [
    "sites = pd.unique(df_lst_and_refl[['sites']].values.ravel('K'))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "id": "10f15ad5-3b92-487a-851b-7a88c207f05c",
   "metadata": {
    "scrolled": true,
    "tags": []
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "AR-Vir start: 2009, end: 2012 and has a size of 1459 (w/o NA: 1408)\n",
      "AU-Ade start: 2007, end: 2009 and has a size of 1094 (w/o NA: 950)\n",
      "AU-ASM start: 2010, end: 2013 and has a size of 1459 (w/o NA: 1355)\n",
      "AU-DaP start: 2007, end: 2013 and has a size of 2553 (w/o NA: 2219)\n",
      "AU-DaS start: 2008, end: 2014 and has a size of 2552 (w/o NA: 2342)\n",
      "AU-Dry start: 2008, end: 2014 and has a size of 2552 (w/o NA: 2215)\n",
      "AU-Fog start: 2006, end: 2008 and has a size of 1094 (w/o NA: 946)\n",
      "AU-Gin start: 2011, end: 2014 and has a size of 1458 (w/o NA: 1448)\n",
      "AU-How start: 2001, end: 2014 and has a size of 5074 (w/o NA: 4379)\n",
      "AU-Stp start: 2008, end: 2014 and has a size of 2552 (w/o NA: 2218)\n",
      "AU-Whr start: 2011, end: 2014 and has a size of 1458 (w/o NA: 1175)\n",
      "AU-Wom start: 2010, end: 2012 and has a size of 1094 (w/o NA: 934)\n",
      "BE-Bra start: 2000, end: 2014 and has a size of 5372 (w/o NA: 5328)\n",
      "BE-Vie start: 2000, end: 2014 and has a size of 5372 (w/o NA: 5320)\n",
      "CH-Fru start: 2005, end: 2014 and has a size of 3646 (w/o NA: 3614)\n",
      "CH-Lae start: 2004, end: 2014 and has a size of 4012 (w/o NA: 3986)\n",
      "CH-Oe1 start: 2002, end: 2008 and has a size of 2538 (w/o NA: 2524)\n",
      "CN-Cng start: 2007, end: 2010 and has a size of 1459 (w/o NA: 1453)\n",
      "CN-Qia start: 2003, end: 2005 and has a size of 1088 (w/o NA: 1072)\n",
      "CZ-wet start: 2006, end: 2014 and has a size of 3282 (w/o NA: 3259)\n",
      "DE-Akm start: 2009, end: 2014 and has a size of 2188 (w/o NA: 2174)\n",
      "DE-Geb start: 2001, end: 2014 and has a size of 5074 (w/o NA: 5040)\n",
      "DE-Gri start: 2004, end: 2014 and has a size of 4012 (w/o NA: 3990)\n",
      "DE-Hai start: 2000, end: 2012 and has a size of 4643 (w/o NA: 4598)\n",
      "DE-Kli start: 2004, end: 2014 and has a size of 4012 (w/o NA: 3986)\n",
      "DE-Obe start: 2008, end: 2014 and has a size of 2552 (w/o NA: 2532)\n",
      "DE-RuR start: 2011, end: 2014 and has a size of 1458 (w/o NA: 1444)\n",
      "DE-Spw start: 2010, end: 2014 and has a size of 1823 (w/o NA: 1810)\n",
      "DE-Tha start: 2000, end: 2014 and has a size of 5372 (w/o NA: 5326)\n",
      "DK-NuF start: 2008, end: 2014 and has a size of 2552 (w/o NA: 2519)\n",
      "DK-Sor start: 2000, end: 2014 and has a size of 5372 (w/o NA: 5329)\n",
      "FI-Hyy start: 2000, end: 2014 and has a size of 5372 (w/o NA: 5346)\n",
      "FI-Sod start: 2001, end: 2014 and has a size of 5074 (w/o NA: 4978)\n",
      "FR-Fon start: 2005, end: 2014 and has a size of 3646 (w/o NA: 3622)\n",
      "FR-LBr start: 2000, end: 2008 and has a size of 3184 (w/o NA: 3147)\n",
      "FR-Pue start: 2000, end: 2014 and has a size of 5372 (w/o NA: 5315)\n",
      "IT-Col start: 2000, end: 2014 and has a size of 5372 (w/o NA: 5322)\n",
      "IT-Cp2 start: 2012, end: 2014 and has a size of 1093 (w/o NA: 1085)\n",
      "IT-Cpz start: 2000, end: 2009 and has a size of 3549 (w/o NA: 3519)\n",
      "IT-Isp start: 2013, end: 2014 and has a size of 729 (w/o NA: 723)\n",
      "IT-Lav start: 2003, end: 2014 and has a size of 4370 (w/o NA: 4340)\n",
      "IT-MBo start: 2003, end: 2013 and has a size of 4006 (w/o NA: 3973)\n",
      "IT-Noe start: 2004, end: 2014 and has a size of 4012 (w/o NA: 3985)\n",
      "IT-PT1 start: 2002, end: 2004 and has a size of 1080 (w/o NA: 1071)\n",
      "IT-Ren start: 2000, end: 2013 and has a size of 5008 (w/o NA: 4959)\n",
      "IT-Ro1 start: 2000, end: 2008 and has a size of 3184 (w/o NA: 3155)\n",
      "IT-SR2 start: 2013, end: 2014 and has a size of 729 (w/o NA: 725)\n",
      "IT-SRo start: 2000, end: 2012 and has a size of 4643 (w/o NA: 4601)\n",
      "IT-Tor start: 2008, end: 2014 and has a size of 2552 (w/o NA: 2525)\n",
      "JP-SMF start: 2002, end: 2006 and has a size of 1809 (w/o NA: 1795)\n",
      "NL-Hor start: 2004, end: 2011 and has a size of 2919 (w/o NA: 2901)\n",
      "NL-Loo start: 2000, end: 2013 and has a size of 5008 (w/o NA: 4963)\n",
      "RU-Fyo start: 2000, end: 2014 and has a size of 5372 (w/o NA: 5341)\n",
      "SD-Dem start: 2005, end: 2009 and has a size of 1823 (w/o NA: 1586)\n",
      "SN-Dhr start: 2010, end: 2013 and has a size of 1459 (w/o NA: 1265)\n",
      "US-GLE start: 2004, end: 2014 and has a size of 4012 (w/o NA: 3962)\n",
      "US-Ha1 start: 2000, end: 2012 and has a size of 4643 (w/o NA: 4523)\n",
      "US-Los start: 2000, end: 2014 and has a size of 5372 (w/o NA: 5263)\n",
      "US-Me2 start: 2002, end: 2014 and has a size of 4726 (w/o NA: 4673)\n",
      "US-MMS start: 2000, end: 2014 and has a size of 5372 (w/o NA: 5245)\n",
      "US-PFa start: 2000, end: 2014 and has a size of 5372 (w/o NA: 5251)\n",
      "US-SRG start: 2008, end: 2014 and has a size of 2552 (w/o NA: 2524)\n",
      "US-SRM start: 2004, end: 2014 and has a size of 4012 (w/o NA: 3964)\n",
      "US-Syv start: 2001, end: 2014 and has a size of 5074 (w/o NA: 4993)\n",
      "US-Ton start: 2001, end: 2014 and has a size of 5074 (w/o NA: 5003)\n",
      "US-UMB start: 2000, end: 2014 and has a size of 5372 (w/o NA: 5247)\n",
      "US-UMd start: 2007, end: 2014 and has a size of 2917 (w/o NA: 2860)\n",
      "US-Var start: 2000, end: 2014 and has a size of 5372 (w/o NA: 5275)\n",
      "US-WCr start: 2000, end: 2014 and has a size of 5372 (w/o NA: 5257)\n",
      "US-Wi4 start: 2002, end: 2005 and has a size of 1444 (w/o NA: 1421)\n",
      "ZM-Mon start: 2000, end: 2009 and has a size of 3549 (w/o NA: 3280)\n"
     ]
    }
   ],
   "source": [
    "for s in sites:\n",
    "    a= df_lst_and_refl[df_lst_and_refl[\"sites\"]==s]\n",
    "    print(f'{s} start: {int(a.iloc[0][\"year_dec_x\"])}, end: {int(a.iloc[len(a)-1][\"year_dec_x\"])} and has a size of {len(a)} (w/o NA: {len(a.dropna())})')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "87a2a508-0cd9-4506-88e0-14b7ae7b46df",
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "5d992711-55b6-4afe-9c8f-ad41de20e59c",
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3 (ipykernel)",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.10.1"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 5
}