Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

DB state catchup in version control #12

Draft
wants to merge 71 commits into
base: main
Choose a base branch
from
Draft

DB state catchup in version control #12

wants to merge 71 commits into from

Commits on Apr 29, 2022

  1. Added some testing files to use as future framework ideas

    @broceni
    broceni committed Apr 29, 2022
    Configuration menu
    Copy the full SHA
    ccb53c4 View commit details
    Browse the repository at this point in the history

Commits on May 5, 2022

  1. Added Workflow Doc

    @broceni
    broceni committed May 5, 2022
    Configuration menu
    Copy the full SHA
    bc4ac83 View commit details
    Browse the repository at this point in the history

  2. Added Testing Workflow Text

    @broceni
    broceni committed May 5, 2022
    Configuration menu
    Copy the full SHA
    567598b View commit details
    Browse the repository at this point in the history

  3. Fixed indentation issue in testLambda.yml

    @olsonadr
    olsonadr authored May 5, 2022
    Configuration menu
    Copy the full SHA
    fd13dee View commit details
    Browse the repository at this point in the history

  4. Updated Tacks

    @broceni
    broceni committed May 5, 2022
    Configuration menu
    Copy the full SHA
    f5aab2a View commit details
    Browse the repository at this point in the history

  5. Merge branch '5-testing-suite' of https://github.com/olsonadr/nlp-lam… 

    …bdas into 5-testing-suite
    @broceni
    broceni committed May 5, 2022
    Configuration menu
    Copy the full SHA
    82b133b View commit details
    Browse the repository at this point in the history

Commits on May 6, 2022

  1. Added SAM version check to workflow

    @olsonadr
    olsonadr authored May 6, 2022
    Configuration menu
    Copy the full SHA
    7f694e0 View commit details
    Browse the repository at this point in the history

  2. Co-authored-by: Nick Olson <[email protected]>

    @broceni
    broceni committed May 6, 2022
    Configuration menu
    Copy the full SHA
    a0a1b02 View commit details
    Browse the repository at this point in the history

  3. Removed Error

    @broceni
    broceni committed May 6, 2022
    Configuration menu
    Copy the full SHA
    dbaef77 View commit details
    Browse the repository at this point in the history

  4. Merge branch '5-testing-suite' of https://github.com/olsonadr/nlp-lam… 

    …bdas into 5-testing-suite
    @broceni
    broceni committed May 6, 2022
    Configuration menu
    Copy the full SHA
    7f4a98c View commit details
    Browse the repository at this point in the history

  5. Getting Default Shell Useage 

    Co-authored-by: Nick Olson <[email protected]>
    @broceni @olsonadr
    broceni and olsonadr committed May 6, 2022
    Configuration menu
    Copy the full SHA
    d2a293b View commit details
    Browse the repository at this point in the history

  6. Trying DefaultShell

    @olsonadr
    olsonadr authored May 6, 2022
    Configuration menu
    Copy the full SHA
    a81d022 View commit details
    Browse the repository at this point in the history

  7. All One Command Trial

    @broceni
    broceni committed May 6, 2022
    Configuration menu
    Copy the full SHA
    4ba075f View commit details
    Browse the repository at this point in the history

  8. Merge branch '5-testing-suite' of https://github.com/olsonadr/nlp-lam… 

    …bdas into 5-testing-suite
    @broceni
    broceni committed May 6, 2022
    Configuration menu
    Copy the full SHA
    8567040 View commit details
    Browse the repository at this point in the history

  9. Remove Default Shell

    @broceni
    broceni committed May 6, 2022
    Configuration menu
    Copy the full SHA
    26d5836 View commit details
    Browse the repository at this point in the history

  10. Trail #555555

    @broceni
    broceni committed May 6, 2022
    Configuration menu
    Copy the full SHA
    a071d04 View commit details
    Browse the repository at this point in the history

  11. Added sam build to workflow

    @olsonadr
    olsonadr authored May 6, 2022
    Configuration menu
    Copy the full SHA
    06f5834 View commit details
    Browse the repository at this point in the history

  12. Fixed typo on sam build :(

    @olsonadr
    olsonadr authored May 6, 2022
    Configuration menu
    Copy the full SHA
    da491a1 View commit details
    Browse the repository at this point in the history

  13. Testing for Lamdba In Place 

    Co-authored-by: Nick Olson <[email protected]>
    @broceni @olsonadr
    broceni and olsonadr committed May 6, 2022
    Configuration menu
    Copy the full SHA
    7ef7e5c View commit details
    Browse the repository at this point in the history

  14. Merge branch '5-testing-suite' of https://github.com/olsonadr/nlp-lam… 

    …bdas into 5-testing-suite
    @broceni
    broceni committed May 6, 2022
    Configuration menu
    Copy the full SHA
    ef82ac1 View commit details
    Browse the repository at this point in the history

  15. Added state_update.py to store new reports from Mongo. Remixed format… 

    …ting in similar.py. Updated state.csv, and renamed old one for testing purposes.
    @Xinnji
    Xinnji committed May 6, 2022
    Configuration menu
    Copy the full SHA
    9408875 View commit details
    Browse the repository at this point in the history

Commits on May 8, 2022

  1. Created several testing documents for use in apitest.py and testrun.p… 

    …y, cleaned up testrun.py and formatted apitest.py
    @broceni
    broceni committed May 8, 2022
    Configuration menu
    Copy the full SHA
    cc1d986 View commit details
    Browse the repository at this point in the history

Commits on May 9, 2022

  1. Fixed path to test

    @broceni
    broceni committed May 9, 2022
    Configuration menu
    Copy the full SHA
    ee13435 View commit details
    Browse the repository at this point in the history

  2. Fixed the test path and file path

    @broceni
    broceni committed May 9, 2022
    Configuration menu
    Copy the full SHA
    13348a6 View commit details
    Browse the repository at this point in the history

Commits on May 11, 2022

  1. Established simple pytest assert-based testing for invoking lambdas

    @olsonadr
    olsonadr committed May 11, 2022
    Configuration menu
    Copy the full SHA
    9a8f9a5 View commit details
    Browse the repository at this point in the history

  2. Add pytest command to testing workflow

    @olsonadr
    olsonadr authored May 11, 2022
    Configuration menu
    Copy the full SHA
    5a94669 View commit details
    Browse the repository at this point in the history

  3. Give pytest environment secrets

    @olsonadr
    olsonadr authored May 11, 2022
    Configuration menu
    Copy the full SHA
    fcd165e View commit details
    Browse the repository at this point in the history

  4. Removed legacy direct tests

    @olsonadr
    olsonadr authored May 11, 2022
    Configuration menu
    Copy the full SHA
    6a7e379 View commit details
    Browse the repository at this point in the history

Commits on May 12, 2022

  1. Attempted API Testing, needs work 

    Co-authored-by: Nick Olson <[email protected]>
    @broceni @olsonadr
    broceni and olsonadr committed May 12, 2022
    Configuration menu
    Copy the full SHA
    5d54b35 View commit details
    Browse the repository at this point in the history

  2. Reset request timeout to 180

    @olsonadr
    olsonadr committed May 12, 2022
    Configuration menu
    Copy the full SHA
    fe74212 View commit details
    Browse the repository at this point in the history

  3. Required apitest and testrun arguments on main call

    @olsonadr
    olsonadr committed May 12, 2022
    Configuration menu
    Copy the full SHA
    4f01bb7 View commit details
    Browse the repository at this point in the history

  4. Deleted legacy tests again :)

    @olsonadr
    olsonadr authored May 12, 2022
    Configuration menu
    Copy the full SHA
    47178c9 View commit details
    Browse the repository at this point in the history

  5. Fixed issue where api_running not reset on kill

    @olsonadr
    olsonadr committed May 12, 2022
    Configuration menu
    Copy the full SHA
    e755a4c View commit details
    Browse the repository at this point in the history

  6. Reset api_running after normal kill

    @olsonadr
    olsonadr committed May 12, 2022
    Configuration menu
    Copy the full SHA
    cfc2bac View commit details
    Browse the repository at this point in the history

  7. Merge branch '5-testing-suite' of github.com:olsonadr/nlp-lambdas int… 

    …o 5-testing-suite
    @olsonadr
    olsonadr committed May 12, 2022
    Configuration menu
    Copy the full SHA
    9953975 View commit details
    Browse the repository at this point in the history

  8. Added back "api_running = True" to start_api

    @olsonadr
    olsonadr committed May 12, 2022
    Configuration menu
    Copy the full SHA
    743ba5b View commit details
    Browse the repository at this point in the history

  9. Fixed backslash in argparse config and added prints on tests

    @olsonadr
    olsonadr committed May 12, 2022
    Configuration menu
    Copy the full SHA
    17e8830 View commit details
    Browse the repository at this point in the history

  10. Fixed final condition on apitest

    @olsonadr
    olsonadr committed May 12, 2022
    Configuration menu
    Copy the full SHA
    1ea5943 View commit details
    Browse the repository at this point in the history

Commits on May 13, 2022

  1. Using relative imports, removed legacy imports/code, non-comparison a… 

    …sserts

Used empty __init__.py files in unit and helpers dirs to use relative imports between the two, removed extra things from pythonpath
Removed unused imports, replaced unused variables with _, removed legacy function
Replaced comparison with direct boolean logic:
 ("assert True==statement" and "assert False==statement")
 become ("assert statement" and "assert not statement")
    @olsonadr
    olsonadr committed May 13, 2022
    Configuration menu
    Copy the full SHA
    712c8bb View commit details
    Browse the repository at this point in the history

  2. Fixed relative import error by adding __init__.py to tests directory

    @olsonadr
    olsonadr committed May 13, 2022
    Configuration menu
    Copy the full SHA
    4a90b79 View commit details
    Browse the repository at this point in the history

  3. Renamed workflow .yml files and added testing step to deploy workflow

    @olsonadr
    olsonadr committed May 13, 2022
    Configuration menu
    Copy the full SHA
    fc5fa29 View commit details
    Browse the repository at this point in the history

  4. Added missing "not" for incorrect input api test

    @olsonadr
    olsonadr committed May 13, 2022
    Configuration menu
    Copy the full SHA
    d1fe351 View commit details
    Browse the repository at this point in the history

  5. Added main pull_request trigger to testing workflow

    @olsonadr
    olsonadr authored May 13, 2022
    Configuration menu
    Copy the full SHA
    6ddbdba View commit details
    Browse the repository at this point in the history

  6. Added new incidents.csv and updated old one to incidents old.csv for … 

    …purposes of testing with the updated state.
    @Xinnji
    Xinnji committed May 13, 2022
    Configuration menu
    Copy the full SHA
    426a140 View commit details
    Browse the repository at this point in the history

  7. Adding two scripts for local inference testing. Accuracy outputs numb… 

    …er of incorrect inferences out of the total, and intervals outputs detailed info about guesses. If using, remember to point the data and state docs to the right files.
    @Xinnji
    Xinnji committed May 13, 2022
    Configuration menu
    Copy the full SHA
    6366933 View commit details
    Browse the repository at this point in the history

  8. Finalize Testing Suite

    @broceni
    broceni committed May 13, 2022
    Configuration menu
    Copy the full SHA
    a526985 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'responsible-ai-collaborative:main' into 5-testing-suite

    @olsonadr
    olsonadr authored May 13, 2022
    Configuration menu
    Copy the full SHA
    9948bc1 View commit details
    Browse the repository at this point in the history

  10. Update README.md

    @broceni
    broceni authored May 13, 2022
    Configuration menu
    Copy the full SHA
    a479d7b View commit details
    Browse the repository at this point in the history

  11. Merge pull request #18 from olsonadr/5-testing-suite 

    5 testing suite
    @broceni
    broceni authored May 13, 2022
    Configuration menu
    Copy the full SHA
    d18ecac View commit details
    Browse the repository at this point in the history

  12. Merge branch 'main' into 4-reduce-size-of-incident_clspt

    @olsonadr
    olsonadr committed May 13, 2022
    Configuration menu
    Copy the full SHA
    d348b40 View commit details
    Browse the repository at this point in the history

  13. Using os.path.join for path to state file

    @olsonadr
    olsonadr committed May 13, 2022
    Configuration menu
    Copy the full SHA
    5cd4aa1 View commit details
    Browse the repository at this point in the history

  14. Changed longformer to use local files in state_update.py

    @olsonadr
    olsonadr committed May 13, 2022
    Configuration menu
    Copy the full SHA
    85e46b9 View commit details
    Browse the repository at this point in the history

  15. Added MONGODB_CONNECTION_STRING to the list of required env vars

    @olsonadr
    olsonadr committed May 13, 2022
    Configuration menu
    Copy the full SHA
    151dc7a View commit details
    Browse the repository at this point in the history

  16. test_intervals and test_accuracy now use local model files from submo… 

    …dule
    @olsonadr
    olsonadr committed May 13, 2022
    Configuration menu
    Copy the full SHA
    bd389d4 View commit details
    Browse the repository at this point in the history

  17. Added db state update to testing and deployment workflows

    @olsonadr
    olsonadr committed May 13, 2022
    Configuration menu
    Copy the full SHA
    e1f73d6 View commit details
    Browse the repository at this point in the history

  18. Added pymongo to pip requirements and moved db_state testers 

    test_accuracy.py and test_intervals.py were being caught by pytest
    @olsonadr
    olsonadr committed May 13, 2022
    Configuration menu
    Copy the full SHA
    38377ec View commit details
    Browse the repository at this point in the history

  19. Added provision to create new state object if state.csv does not exist.

    @Xinnji
    Xinnji committed May 13, 2022
    Configuration menu
    Copy the full SHA
    493e65b View commit details
    Browse the repository at this point in the history

  20. Merge branch '4-reduce-size-of-incident_clspt' of https://github.com/… 

    …olsonadr/nlp-lambdas into 4-reduce-size-of-incident_clspt
    @Xinnji
    Xinnji committed May 13, 2022
    Configuration menu
    Copy the full SHA
    dd62269 View commit details
    Browse the repository at this point in the history

  21. Fixed environment secrets for db_state update in workflow 

    Added MONGODB_CONNECTION_STRING to the workflow environment for db_state
    @olsonadr
    olsonadr committed May 13, 2022
    Configuration menu
    Copy the full SHA
    d14d9d2 View commit details
    Browse the repository at this point in the history

  22. Added requried [srv] option to pymongo requirement

    @olsonadr
    olsonadr committed May 13, 2022
    Configuration menu
    Copy the full SHA
    54263a0 View commit details
    Browse the repository at this point in the history

  23. Merge pull request #20 from olsonadr/4-reduce-size-of-incident_clspt 

    4 reduce size of incident clspt
    @olsonadr
    olsonadr authored May 13, 2022
    Configuration menu
    Copy the full SHA
    a957e24 View commit details
    Browse the repository at this point in the history

  24. Update README.md

    @Xinnji
    Xinnji authored May 13, 2022
    Configuration menu
    Copy the full SHA
    b7aafa0 View commit details
    Browse the repository at this point in the history

  25. Update README.md

    @Xinnji
    Xinnji authored May 13, 2022
    Configuration menu
    Copy the full SHA
    2b1a36b View commit details
    Browse the repository at this point in the history

  26. Update README.md

    @Xinnji
    Xinnji authored May 13, 2022
    Configuration menu
    Copy the full SHA
    c53569b View commit details
    Browse the repository at this point in the history

  27. Update README.md

    @olsonadr
    olsonadr authored May 13, 2022
    Configuration menu
    Copy the full SHA
    1b0915d View commit details
    Browse the repository at this point in the history

  28. Moved state_update.py to project root, updated README 

    Where it was in a subdir of the inference dir, it was being picked up as a lambda specification
    @olsonadr
    olsonadr committed May 13, 2022
    Configuration menu
    Copy the full SHA
    b0f1602 View commit details
    Browse the repository at this point in the history

Commits on May 14, 2022

  1. Merge pull request #21 from olsonadr/move-update-state-out-of-inference 

    Moved state_update.py to project root, updated README
    @olsonadr
    olsonadr authored May 14, 2022
    Configuration menu
    Copy the full SHA
    e3c2249 View commit details
    Browse the repository at this point in the history

  2. Create README.md

    @smcgregor
    smcgregor authored May 14, 2022
    Configuration menu
    Copy the full SHA
    452496c View commit details
    Browse the repository at this point in the history

Commits on May 23, 2022

  1. Merge branch 'responsible-ai-collaborative:main' into main

    @olsonadr
    olsonadr authored May 23, 2022
    Configuration menu
    Copy the full SHA
    3531be4 View commit details
    Browse the repository at this point in the history

Commits on May 25, 2022

  1. Changed model initialization in state_update.py and similar.py to def… 

    …ine model max length, and thus truncate abnormally long tensors of tokens, solving an indexing error encountered while updating incident 195. Removed manual truncation in similar.py. Refactored the names of a couple constants in similar.py.
    @Xinnji
    Xinnji committed May 25, 2022
    Configuration menu
    Copy the full SHA
    a61a46f View commit details
    Browse the repository at this point in the history

  2. Updated state.csv with state_update.py.

    @Xinnji
    Xinnji committed May 25, 2022
    Configuration menu
    Copy the full SHA
    aa22b0b View commit details
    Browse the repository at this point in the history