README.md

---
base_model:
- deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B
license: mit
pipeline_tag: text-generation
library_name: transformers
---

# Mixture-Math-DeepSeek-R1-Distill-Qwen-1.5B

[🌐 Project Page](https://recursivemas.github.io) | [💻 Code](https://github.com/RecursiveMAS/RecursiveMAS) | [📄 Paper](https://arxiv.org/abs/2604.25917)

We introduce **RecursiveMAS**, a multi-agent framework that scales agent collaboration through **latent-space recursion**. 
RecursiveMAS treats a multi-agent system as a unified recursive computation, where heterogeneous agents iteratively exchange, refine, and evolve their latent states across recursion rounds. 

In the Mixture-Style setting, this **Math Specialist Agent** focuses on mathematical reasoning tasks and collaborates with other domain-specialized agents through RecursiveLink modules for final response generation.

The model was presented in the paper [Recursive Multi-Agent Systems](https://huggingface.co/papers/2604.25917).

## Model Details

| Item | Description |
|---|---|
| **Model** | Mixture-Math-DeepSeek-R1-Distill-Qwen-1.5B |
| **Collaboration Style** | Mixture-Style |
| **Agent Role** | Math Specialist Agent |
| **Base Model** | [DeepSeek-R1-Distill-Qwen-1.5B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B) |

⚠️ **Note:** This checkpoint is a **role-specific agent** in [**RecursiveMAS**](https://arxiv.org/abs/2604.25917), rather than a standalone model intended for plain-text generation. 

## Usage

To use this model as part of the RecursiveMAS system, you can load the entire multi-agent pipeline using the provided system loader from the [official repository](https://github.com/RecursiveMAS/RecursiveMAS):

```python
# Requires cloning the repository: git clone https://github.com/RecursiveMAS/RecursiveMAS.git
from system_loader import load_mas_system

mas = load_mas_system(
    style="mixture",
    device="cuda",
    trust_remote_code=True,
)

# Access individual agents
math_agent = mas.agents["math"].model
```

## Model Collections for RecursiveMAS

| Style | Model Collection |
|---|---|
| Sequential-Style | [🤗 HuggingFace](https://huggingface.co/collections/RecursiveMAS/sequential-style-recursivemas) |
| Mixture-Style | [🤗 HuggingFace](https://huggingface.co/collections/RecursiveMAS/mixture-style-recursivemas) |
| Distillation-Style | [🤗 HuggingFace](https://huggingface.co/collections/RecursiveMAS/distillation-style-recursivemas) |
| Deliberation-Style | [🤗 HuggingFace](https://huggingface.co/collections/RecursiveMAS/deliberation-style-recursivemas) |

## Experiment Results

<p align="center">
  <img src="https://raw.githubusercontent.com/RecursiveMAS/RecursiveMAS/main/assets/hero_fig.png" width="95%" alt="RecursiveMAS Experiment Results">
</p>

## Citation

```bibtex
@misc{recursivemas,
      title={Recursive Multi-Agent Systems}, 
      author={Xiyuan Yang and Jiaru Zou and Rui Pan and Ruizhong Qiu and Pan Lu and Shizhe Diao and Jindong Jiang and Hanghang Tong and Tong Zhang and Markus J. Buehler and Jingrui He and James Zou},
      year={2026},
      eprint={2604.25917},
      archivePrefix={arXiv},
      primaryClass={cs.AI},
      url={https://arxiv.org/abs/2604.25917}, 
}
```