| | --- |
| | license: cc-by-nc-4.0 |
| | tags: |
| | - merge |
| | - mergekit |
| | - vortexmergekit |
| | - chihoonlee10/T3Q-Mistral-Orca-Math-DPO |
| | - eldogbbhed/NeuralMonarchCoderPearlBeagle |
| | --- |
| | |
| | # NeuralMonarchCoderPearlBeagle-T3Q-Mistral-Orca-Math-DPO-7b |
| |
|
| | This is a merge of multiple models brought together using the awesome [VortexMerge kit](https://colab.research.google.com/drive/1YjcvCLuNG1PK7Le6_4xhVU5VpzTwvGhk#scrollTo=UG5H2TK4gVyl). |
| |
|
| | Let's see what we've got in this merge: |
| | * [chihoonlee10/T3Q-Mistral-Orca-Math-DPO](https://huggingface.co/chihoonlee10/T3Q-Mistral-Orca-Math-DPO) 🚀 |
| | * [eldogbbhed/NeuralMonarchCoderPearlBeagle](https://huggingface.co/eldogbbhed/NeuralMonarchCoderPearlBeagle) 🚀 |
| |
|
| | ## 🧩 Configuration |
| |
|
| | ```yaml |
| | models: |
| | - model: mlabonne/NeuralBeagle14-7B |
| | # no parameters necessary for base model |
| | - model: chihoonlee10/T3Q-Mistral-Orca-Math-DPO |
| | parameters: |
| | density: 0.5 |
| | weight: 0.5 |
| | - model: eldogbbhed/NeuralMonarchCoderPearlBeagle |
| | parameters: |
| | density: 0.5 |
| | weight: 0.3 |
| | merge_method: ties |
| | base_model: mlabonne/NeuralBeagle14-7B |
| | parameters: |
| | normalize: true |
| | int8_mask: true |
| | dtype: float16 |
| | |
