Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Provide support for batch scraping #2459

Merged
merged 136 commits into from
Oct 7, 2024

Commits on Mar 19, 2024

  1. Configuration menu
    Copy the full SHA
    163713d View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    d0f4c73 View commit details
    Browse the repository at this point in the history

Commits on Mar 20, 2024

  1. Configuration menu
    Copy the full SHA
    2552197 View commit details
    Browse the repository at this point in the history

Commits on Mar 21, 2024

  1. Configuration menu
    Copy the full SHA
    975eef7 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    40289da View commit details
    Browse the repository at this point in the history

Commits on Mar 23, 2024

  1. Configuration menu
    Copy the full SHA
    e9e385a View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    d6fe4ff View commit details
    Browse the repository at this point in the history

Commits on May 30, 2024

  1. Configuration menu
    Copy the full SHA
    55b88f9 View commit details
    Browse the repository at this point in the history

Commits on Jun 16, 2024

  1. github action image build

    hkfgo committed Jun 16, 2024
    Configuration menu
    Copy the full SHA
    6647ef1 View commit details
    Browse the repository at this point in the history
  2. github action image build

    hkfgo committed Jun 16, 2024
    Configuration menu
    Copy the full SHA
    77640a7 View commit details
    Browse the repository at this point in the history

Commits on Jul 15, 2024

  1. Configuration menu
    Copy the full SHA
    3b4ce25 View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2024

  1. Configuration menu
    Copy the full SHA
    9e7c0cd View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2024

  1. Configuration menu
    Copy the full SHA
    c9bd29b View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    43882d6 View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2024

  1. Configuration menu
    Copy the full SHA
    ff14367 View commit details
    Browse the repository at this point in the history

Commits on Jul 30, 2024

  1. Configuration menu
    Copy the full SHA
    3e3ef54 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    e290f90 View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2024

  1. Configuration menu
    Copy the full SHA
    c7a3fff View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2024

  1. restrict batch scraping to only Azure Monitor scraper for now + defin…

    …e MeasuredMetric wit resource ID
    hkfgo committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    f35fce4 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    e8cf5e1 View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2024

  1. Configuration menu
    Copy the full SHA
    10f1599 View commit details
    Browse the repository at this point in the history
  2. obtain testable build

    hkfgo committed Aug 4, 2024
    Configuration menu
    Copy the full SHA
    a5966fa View commit details
    Browse the repository at this point in the history

Commits on Aug 8, 2024

  1. Configuration menu
    Copy the full SHA
    83761b2 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    94120b5 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    ca59552 View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2024

  1. Configuration menu
    Copy the full SHA
    106bfbd View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2024

  1. Configuration menu
    Copy the full SHA
    cad0752 View commit details
    Browse the repository at this point in the history
  2. fix test

    hkfgo committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    30b535f View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    963b71a View commit details
    Browse the repository at this point in the history
  4. add logging

    hkfgo committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    e1a8365 View commit details
    Browse the repository at this point in the history
  5. add logging

    hkfgo committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    a93f065 View commit details
    Browse the repository at this point in the history
  6. add logging on scraper

    hkfgo committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    4342ae2 View commit details
    Browse the repository at this point in the history
  7. add logging on scraper

    hkfgo committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    6b0dcbb View commit details
    Browse the repository at this point in the history
  8. add logging on scraper

    hkfgo committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    f773058 View commit details
    Browse the repository at this point in the history

Commits on Aug 15, 2024

  1. log exception details

    hkfgo committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    c3aa159 View commit details
    Browse the repository at this point in the history
  2. add more logging on query tasks

    hkfgo committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    3539362 View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2024

  1. make region configurable

    hkfgo committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    3cc8359 View commit details
    Browse the repository at this point in the history
  2. try fixing regional metrics URL

    hkfgo committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    7a8fc27 View commit details
    Browse the repository at this point in the history

Commits on Aug 17, 2024

  1. fix batch API URL formatting

    hkfgo committed Aug 17, 2024
    Configuration menu
    Copy the full SHA
    bb71f0d View commit details
    Browse the repository at this point in the history
  2. fix batch API URL formatting

    hkfgo committed Aug 17, 2024
    Configuration menu
    Copy the full SHA
    c79750d View commit details
    Browse the repository at this point in the history
  3. debug query range

    hkfgo committed Aug 17, 2024
    Configuration menu
    Copy the full SHA
    5a1fc33 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    be7b18b View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    a58318f View commit details
    Browse the repository at this point in the history
  6. lower case aggregations

    hkfgo committed Aug 17, 2024
    Configuration menu
    Copy the full SHA
    187459c View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    fdabad9 View commit details
    Browse the repository at this point in the history
  8. log filter

    hkfgo committed Aug 17, 2024
    Configuration menu
    Copy the full SHA
    b2cfd79 View commit details
    Browse the repository at this point in the history
  9. log more query params

    hkfgo committed Aug 17, 2024
    Configuration menu
    Copy the full SHA
    dd9d248 View commit details
    Browse the repository at this point in the history
  10. log outgoing requests

    hkfgo committed Aug 17, 2024
    Configuration menu
    Copy the full SHA
    a90bf15 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    f2d51f2 View commit details
    Browse the repository at this point in the history
  12. log ID resposne

    hkfgo committed Aug 17, 2024
    Configuration menu
    Copy the full SHA
    6406cbe View commit details
    Browse the repository at this point in the history

Commits on Aug 19, 2024

  1. Configuration menu
    Copy the full SHA
    be8638c View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    3e8e095 View commit details
    Browse the repository at this point in the history
  3. log resource definition cache

    hkfgo committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    694a856 View commit details
    Browse the repository at this point in the history
  4. log resource definition cache

    hkfgo committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    63d9a03 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    71fb195 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    f02eaaa View commit details
    Browse the repository at this point in the history
  7. fix fix

    hkfgo committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    6a0d2bf View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2024

  1. Configuration menu
    Copy the full SHA
    78bf03c View commit details
    Browse the repository at this point in the history
  2. try range query again

    hkfgo committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    7e583a9 View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2024

  1. Configuration menu
    Copy the full SHA
    802a9d2 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b26c9aa View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    e85c255 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    0dba964 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    604ad76 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    5b0b4cd View commit details
    Browse the repository at this point in the history
  7. go back to batch scraping CI

    hkfgo committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    cb1b696 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    834819d View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2024

  1. Configuration menu
    Copy the full SHA
    a3410b8 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    70e4a3f View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    de785df View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    0b463e7 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    082a6e6 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    beab4e6 View commit details
    Browse the repository at this point in the history
  7. add more debug logging

    hkfgo committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    6c721ab View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    5d8b5ef View commit details
    Browse the repository at this point in the history
  9. account for limit

    hkfgo committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    fc0362d View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    4dff71b View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2024

  1. Configuration menu
    Copy the full SHA
    cbc7e06 View commit details
    Browse the repository at this point in the history
  2. improve regex matching

    hkfgo committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    30aa153 View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2024

  1. Configuration menu
    Copy the full SHA
    2a42416 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2024

  1. add more debug logging

    hkfgo committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    b77903d View commit details
    Browse the repository at this point in the history
  2. use configured max batch size

    hkfgo committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    a2da4a5 View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2024

  1. use cached resource definition

    hkfgo committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    124acbc View commit details
    Browse the repository at this point in the history
  2. go back

    hkfgo committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    c5fd2be View commit details
    Browse the repository at this point in the history
  3. go back

    hkfgo committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    51e589f View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2024

  1. use an older collector version

    hkfgo committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    3760629 View commit details
    Browse the repository at this point in the history
  2. use different string matching

    hkfgo committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    4853b3e View commit details
    Browse the repository at this point in the history
  3. run prom exporter on localhost

    hkfgo committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    e2a013f View commit details
    Browse the repository at this point in the history
  4. try insecure flag

    hkfgo committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    c29399a View commit details
    Browse the repository at this point in the history
  5. fix style issues

    hkfgo committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    027254b View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    d0c7b41 View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2024

  1. Configuration menu
    Copy the full SHA
    46931e8 View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2024

  1. Configuration menu
    Copy the full SHA
    d4a0545 View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2024

  1. Configuration menu
    Copy the full SHA
    8a0e380 View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2024

  1. fix style issues

    hkfgo committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    d88c53b View commit details
    Browse the repository at this point in the history
  2. fix style

    hkfgo committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    a853c26 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2024

  1. Address comments

    hkfgo committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    430c725 View commit details
    Browse the repository at this point in the history
  2. more style fixes

    hkfgo committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    11d765c View commit details
    Browse the repository at this point in the history
  3. consolidate some logging

    hkfgo committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    5d38684 View commit details
    Browse the repository at this point in the history
  4. more style fixes :(

    hkfgo committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    b3eb049 View commit details
    Browse the repository at this point in the history
  5. add null check

    hkfgo committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    9073887 View commit details
    Browse the repository at this point in the history
  6. avoid naming collision

    hkfgo committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    e1c96b1 View commit details
    Browse the repository at this point in the history
  7. fix fix style

    hkfgo committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    172cd33 View commit details
    Browse the repository at this point in the history
  8. make config settable

    hkfgo committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    299ec6e View commit details
    Browse the repository at this point in the history
  9. get rid of some redundant code

    hkfgo committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    b2d3458 View commit details
    Browse the repository at this point in the history
  10. Fighting resharper

    hkfgo committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    47672d6 View commit details
    Browse the repository at this point in the history
  11. Fighting resharper

    hkfgo committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    06e404d View commit details
    Browse the repository at this point in the history
  12. add null check

    hkfgo committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    af638b0 View commit details
    Browse the repository at this point in the history
  13. add null check

    hkfgo committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    4573300 View commit details
    Browse the repository at this point in the history
  14. add simple unit test

    hkfgo committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    9f25804 View commit details
    Browse the repository at this point in the history
  15. Revert CI workflow changes

    hkfgo committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    943e437 View commit details
    Browse the repository at this point in the history
  16. get rid of excessive logging

    hkfgo committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    88f43cc View commit details
    Browse the repository at this point in the history
  17. add a link to docs

    hkfgo committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    c790b54 View commit details
    Browse the repository at this point in the history
  18. close ref

    hkfgo committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    ce56dbb View commit details
    Browse the repository at this point in the history
  19. Configuration menu
    Copy the full SHA
    04ff115 View commit details
    Browse the repository at this point in the history
  20. handle windows time

    hkfgo committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    31669c5 View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2024

  1. Configuration menu
    Copy the full SHA
    b82b73d View commit details
    Browse the repository at this point in the history

Commits on Oct 1, 2024

  1. Configuration menu
    Copy the full SHA
    c4b1041 View commit details
    Browse the repository at this point in the history
  2. ci changes

    hkfgo committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    fa2fc3f View commit details
    Browse the repository at this point in the history
  3. add logging

    hkfgo committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    216812b View commit details
    Browse the repository at this point in the history
  4. add logging

    hkfgo committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    c7a4a6a View commit details
    Browse the repository at this point in the history
  5. add logging

    hkfgo committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    e27d581 View commit details
    Browse the repository at this point in the history
  6. add logging

    hkfgo committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    f1a2c48 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    c72bda1 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    206e155 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    67bf0a5 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    f04cb87 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    377bdfd View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    431f37d View commit details
    Browse the repository at this point in the history
  13. do not run batch mode in CI

    hkfgo committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    86b4ddd View commit details
    Browse the repository at this point in the history
  14. trigger CI again

    hkfgo committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    eb6d676 View commit details
    Browse the repository at this point in the history
  15. Modify workflow file again

    hkfgo committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    f2e0087 View commit details
    Browse the repository at this point in the history
  16. revert GitHubaction

    hkfgo committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    fedf814 View commit details
    Browse the repository at this point in the history
  17. remove more debug logging

    hkfgo committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    988da9b View commit details
    Browse the repository at this point in the history
  18. retry-ci

    hkfgo committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    fd14f63 View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2024

  1. retry-ci

    hkfgo committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    1face30 View commit details
    Browse the repository at this point in the history