pip3 install vllm
pip3 install seqeval
Dataset is present in the dataset directory
Here we take Alpacare model to finetune (AlpaCare ) https://huggingface.co/xz97/AlpaCare-llama1-7b
bash train_instruct.sh
Run the following scrpit to test the best model
python3 inference_instruct_vllm.py
Run the following script and change the input of the prediction.py file with output obtained by running inference code
python3 prediction.py