Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Dummy inference engine #325 #331

Open
wants to merge 13 commits into
base: main
Choose a base branch
from
Open

Dummy inference engine #325 #331

wants to merge 13 commits into from
+240 −7

Commits on Oct 10, 2024

  1. Add DummyInferenceEngine implementation

    @ji-cryptocafe
    ji-cryptocafe committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    c02752f View commit details
    Browse the repository at this point in the history

  2. Add tests for DummyInferenceEngine

    @ji-cryptocafe
    ji-cryptocafe committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    7317424 View commit details
    Browse the repository at this point in the history

  3. updated pytest settings in pyproject.toml and update dummyInferenceEn… 

    …gine
    @ji-cryptocafe
    ji-cryptocafe committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    f5a7566 View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2024

  1. updated pytest settings for random test

    @ji-cryptocafe
    ji-cryptocafe committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    5abc446 View commit details
    Browse the repository at this point in the history

  2. Implemented DummyInferenceEngine with CLI support and fixed latency t… 

    …est issues.

- Added CLI argument support `--inference-engine dummy` to use DummyInferenceEngine.
- Fixed intermittent failure in latency test by allowing a small timing tolerance.
- Refactored DummyInferenceEngine to ensure correct output and behavior.
- Refactored leftover code in test_dummy_inference_engine and DummyInferenceEngine
    @ji-cryptocafe
    ji-cryptocafe committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    96510e7 View commit details
    Browse the repository at this point in the history

  3. code cleanup

    @ji-cryptocafe
    ji-cryptocafe committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    c66cad4 View commit details
    Browse the repository at this point in the history

Commits on Oct 12, 2024

  1. DummyInferenceEngine implements abstract class 

    updated test cases and enables cli run of dummy
    @ji-cryptocafe
    ji-cryptocafe committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    a622a39 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2024

  1. Merge branch 'exo-explore:main' into dummy-inference-branch

    @ji-cryptocafe
    ji-cryptocafe authored Oct 18, 2024
    Configuration menu
    Copy the full SHA
    6545903 View commit details
    Browse the repository at this point in the history

  2. Two versions of Dummy inference 

    - DummyInferenceEngine : not loading any model, random output
- DummyShardInferenceEngine : loading DummyModel, random output
- DummyInferenceEngine2 : not loading any model, output = input
    @ji-cryptocafe
    ji-cryptocafe committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    76b03ef View commit details
    Browse the repository at this point in the history

  3. removed unused classes, 

    updated DummyInferenceEngine2
added tests for DummyInferenceEngine2
    @ji-cryptocafe
    ji-cryptocafe committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    56519b8 View commit details
    Browse the repository at this point in the history

  4. dummyInferenceEngine 

    - simulates inference with 20% random chance for finishing
- not loading model, but simulates loading latency
- testcases
    @ji-cryptocafe
    ji-cryptocafe committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    22bd9ad View commit details
    Browse the repository at this point in the history

  5. fixed class name error

    @ji-cryptocafe
    ji-cryptocafe committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    5a06b18 View commit details
    Browse the repository at this point in the history

  6. merged

    @ji-cryptocafe
    ji-cryptocafe committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    7ad00ab View commit details
    Browse the repository at this point in the history