This is a repo to locate induction heads in a 4-bit quantized version of Mistral 7B (ih_sweep.ipynb) and then study the impact of ablating them on a question-answering task (ih_babi.ipynb). The dictionaries ih_evaluators.pkl and ih_scores.pkl contain the output of ih_sweep.ipynb, and ih_scores.pkl is necessary to run ih_babi.pynb. See each notebook for more detailed documentation.