You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When I tried to run benchmarking with the example given in the document https://crfm-helm.readthedocs.io/en/latest/quick_start/, I followed exactly the instructions given. However, when I run "helm-run --conf-paths run_entries.conf --suite v1 --max-eval-instances 10", I got "NotADirectoryError" and "helm.benchmark.runner.RunnerError". I attached some screenshots of traceback below.
Could anyone help me with this issue?
Thank you very much!
The text was updated successfully, but these errors were encountered:
Hi, it looks like you're trying to run helm-run on Windows, which is not currently supported. We're planning to add support in the next couple of months. Alternatively, you can run helm-run on Linux instead using WSL2.
Hi, Thank you for developing this amazing benchmark!
I created a virtual environment using anaconda and successfully installed crfm-helm (I followed the instructions from the official document https://crfm-helm.readthedocs.io/en/latest/installation/.
When I tried to run benchmarking with the example given in the document https://crfm-helm.readthedocs.io/en/latest/quick_start/, I followed exactly the instructions given. However, when I run "helm-run --conf-paths run_entries.conf --suite v1 --max-eval-instances 10", I got "NotADirectoryError" and "helm.benchmark.runner.RunnerError". I attached some screenshots of traceback below.
Could anyone help me with this issue?
Thank you very much!
The text was updated successfully, but these errors were encountered: