Update README.md
Browse files
README.md
CHANGED
|
@@ -115,46 +115,34 @@ This AI model can be embedded as an Application Programming Interface (API) call
|
|
| 115 |
|
| 116 |
# Training and Evaluation Datasets
|
| 117 |
|
|
|
|
| 118 |
## Training Dataset
|
| 119 |
|
| 120 |
-
**
|
| 121 |
|
| 122 |
-
|
| 123 |
-
** Data
|
| 124 |
-
*
|
| 125 |
-
**
|
| 126 |
-
*
|
| 127 |
-
** Data Collection Method by dataset <br>
|
| 128 |
-
* Automated <br>
|
| 129 |
-
** Labeling Method by dataset <br>
|
| 130 |
-
* Not Applicable (no labels are needed; supervision comes from teacher models via multi-teacher distillation) <br>
|
| 131 |
-
**Properties:** ~172M total training samples processed over 300k optimizer steps (less than one epoch over the source dataset). Global batch size of 512 low-resolution images (sampled from 128, 192, 224, 256, 384, 432 px) plus 64 high-resolution images (from 512, 768, 1024, 1152 px). <br>
|
| 132 |
|
| 133 |
## Evaluation Datasets
|
| 134 |
|
| 135 |
-
ADE20K
|
| 136 |
-
|
| 137 |
-
* [ADE20K](https://ade20k.csail.mit.edu/)
|
| 138 |
-
*
|
| 139 |
-
* Manually-Collected
|
| 140 |
-
**
|
| 141 |
-
*
|
| 142 |
-
|
| 143 |
-
*
|
| 144 |
-
|
| 145 |
-
*
|
| 146 |
-
|
| 147 |
-
|
| 148 |
-
**
|
| 149 |
-
*
|
| 150 |
-
** Data Collection <br>
|
| 151 |
-
* Automated <br>
|
| 152 |
-
** Labeling Method <br>
|
| 153 |
-
* Manually-Collected <br>
|
| 154 |
-
** Training Images <br>
|
| 155 |
-
* 1,281,167 <br>
|
| 156 |
-
** Validation Images <br>
|
| 157 |
-
* 50,000 <br>
|
| 158 |
|
| 159 |
For downstream VLM evaluation, RADIO1D was paired with the Nemotron-Nano-9B-v2 LLM in the Nemotron VL framework and evaluated on TextVQA, DocVQA, InfoVQA, OCRBench, OCRBench v2 (EN/CN), AI2D, ChartQA, MMMU, SeedBench, and LongVideoBench.
|
| 160 |
|
|
|
|
| 115 |
|
| 116 |
# Training and Evaluation Datasets
|
| 117 |
|
| 118 |
+
|
| 119 |
## Training Dataset
|
| 120 |
|
| 121 |
+
**NV-CC-Img-Text-Dataset**
|
| 122 |
|
| 123 |
+
* **Data Modality:** Image
|
| 124 |
+
* **Image Training Data Size:** 1 Million to 1 Billion Images
|
| 125 |
+
* **Data Collection Method by dataset:** Automated
|
| 126 |
+
* **Labeling Method by dataset:** Not Applicable (no labels are needed; supervision comes from teacher models via multi-teacher distillation)
|
| 127 |
+
* **Properties:** ~172M total training samples processed over 300k optimizer steps (less than one epoch over the source dataset). Global batch size of 512 low-resolution images (sampled from 128, 192, 224, 256, 384, 432 px) plus 64 high-resolution images (from 512, 768, 1024, 1152 px).
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 128 |
|
| 129 |
## Evaluation Datasets
|
| 130 |
|
| 131 |
+
**ADE20K**
|
| 132 |
+
|
| 133 |
+
* **Link:** [ADE20K](https://ade20k.csail.mit.edu/)
|
| 134 |
+
* **Data Collection:** Manually-Collected
|
| 135 |
+
* **Labeling Method:** Manually-Collected
|
| 136 |
+
* **Training Images:** 25,574
|
| 137 |
+
* **Validation Images:** 2,000
|
| 138 |
+
|
| 139 |
+
**ImageNet**
|
| 140 |
+
|
| 141 |
+
* **Link:** [ImageNet](https://www.image-net.org/)
|
| 142 |
+
* **Data Collection:** Automated
|
| 143 |
+
* **Labeling Method:** Manually-Collected
|
| 144 |
+
* **Training Images:** 1,281,167
|
| 145 |
+
* **Validation Images:** 50,000
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 146 |
|
| 147 |
For downstream VLM evaluation, RADIO1D was paired with the Nemotron-Nano-9B-v2 LLM in the Nemotron VL framework and evaluated on TextVQA, DocVQA, InfoVQA, OCRBench, OCRBench v2 (EN/CN), AI2D, ChartQA, MMMU, SeedBench, and LongVideoBench.
|
| 148 |
|