Add model card, library name, and pipeline tag
#1
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,3 +1,55 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
+
library_name: transformers
|
| 4 |
+
pipeline_tag: video-text-to-text
|
| 5 |
---
|
| 6 |
+
|
| 7 |
+
# DAR-R1
|
| 8 |
+
|
| 9 |
+
This is the official model checkpoint for **DAR-R1** (built on top of Qwen2.5-VL-3B-Instruct), presented in the paper:
|
| 10 |
+
[Benchmarking Dynamic Affective Reasoning: A Viewer-Centric Video Emotion Dataset](https://arxiv.org/abs/2607.10238).
|
| 11 |
+
|
| 12 |
+
## Overview
|
| 13 |
+
|
| 14 |
+
**Dynamic Affective Reasoning (DAR)** is a viewer-centric video emotion benchmark. Instead of assigning a single static label to a whole clip, DAR asks a model to identify when the viewer's emotion changes (affective segmentation), what the fine-grained emotion is (fine-grained emotion classification), and why the visual event triggers that affective reaction (affective reasoning).
|
| 15 |
+
|
| 16 |
+
The benchmark contains 15,087 videos, 36,908 event-aligned affective segments, and 27 emotion categories. Each segment includes a temporal span, an emotion label, and a visually grounded causal rationale.
|
| 17 |
+
|
| 18 |
+
**DAR-R1** is trained using a two-stage framework:
|
| 19 |
+
1. **Cold-Start SFT**: Adapts Qwen2.5-VL-3B-Instruct to the structured DAR output format.
|
| 20 |
+
2. **GRPO Training**: Uses Group Relative Policy Optimization (GRPO) to refine temporal localization, emotion prediction, and reasoning quality.
|
| 21 |
+
|
| 22 |
+
## Resources
|
| 23 |
+
|
| 24 |
+
- **GitHub Repository:** [Zhang-Zhiyan/DAR](https://github.com/Zhang-Zhiyan/DAR)
|
| 25 |
+
- **Hugging Face Dataset:** [aiaiaizzy/DAR-R1](https://huggingface.co/datasets/aiaiaizzy/DAR-R1)
|
| 26 |
+
- **Paper:** [arXiv:2607.10238](https://arxiv.org/abs/2607.10238)
|
| 27 |
+
|
| 28 |
+
## Quick Start (Evaluation)
|
| 29 |
+
|
| 30 |
+
To run evaluation using the official script from the repository:
|
| 31 |
+
|
| 32 |
+
```bash
|
| 33 |
+
python test.py \
|
| 34 |
+
--model-path /path/to/DAR-R1 \
|
| 35 |
+
--test-jsonl /path/to/DAR/test.jsonl \
|
| 36 |
+
--video-root /path/to/DAR/videos \
|
| 37 |
+
--output-jsonl /path/to/outputs/dar_r1_test_predictions.jsonl \
|
| 38 |
+
--batch-size 8
|
| 39 |
+
```
|
| 40 |
+
|
| 41 |
+
## Citation
|
| 42 |
+
|
| 43 |
+
If you find this model or the DAR benchmark useful in your research, please consider citing:
|
| 44 |
+
|
| 45 |
+
```bibtex
|
| 46 |
+
@misc{zhang2026benchmarkingdynamicaffectivereasoning,
|
| 47 |
+
title={Benchmarking Dynamic Affective Reasoning: A Viewer-Centric Video Emotion Dataset},
|
| 48 |
+
author={Zhiyan Zhang and Peipei Song and Jinpeng Hu and Jingyang Jia and Xun Yang and Xiaojun Chang},
|
| 49 |
+
year={2026},
|
| 50 |
+
eprint={2607.10238},
|
| 51 |
+
archivePrefix={arXiv},
|
| 52 |
+
primaryClass={cs.CV},
|
| 53 |
+
url={https://arxiv.org/abs/2607.10238},
|
| 54 |
+
}
|
| 55 |
+
```
|