| | --- |
| | license: apache-2.0 |
| | --- |
| | |
| | see our paper in: [https://arxiv.org/abs/2310.05506](https://arxiv.org/abs/2310.05506) |
| |
|
| | ## Model Details |
| |
|
| | MuggleMATH is fully fine-tuned on the AugGSM8K and AugMATH datasets and based on the LLaMA-2 Models. |
| |
|
| | ## **Model Usage** |
| |
|
| | prompting template: |
| | ''' |
| | "Below is an instruction that describes a task. " "Write a response that appropriately completes the request.\n\n" "### Instruction:\n{instruction}\n\n### Response:" |
| | ''' |
| | We recommend using vllm to accelerate inference. |
| |
|
| | ## Experiment |
| |
|
| | | | GSM8K | MATH | |
| | | --- | --- | --- | |
| | | MuggleMATH-7B | 69.8 | 25.8 | |
| | | MuggleMATH-13B | 74.3 | 30.7 | |
| | | MuggleMATH-70B | 82.5 | 42.1 | |
| |
|
| | ## **Citation** |
| |
|
| | @misc{li2023query, |
| | title={Query and Response Augmentation Cannot Help Out-of-domain Math Reasoning Generalization}, |
| | author={Chengpeng Li and Zheng Yuan and Hongyi Yuan and Guanting Dong and Keming Lu and Jiancan Wu and Chuanqi Tan and Xiang Wang and Chang Zhou}, |
| | journal={arXiv preprint arXiv: 2310.05506}, |
| | year={2023} |
| | } |
| | |
