Video-Text-to-Text
Transformers
Safetensors
English
moss_vl
feature-extraction
SFT
Video-Understanding
Image-Understanding
MOSS-VL
OpenMOSS
multimodal
video
vision-language
custom_code
Instructions to use OpenMOSS-Team/MOSS-VL-Instruct-0708 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use OpenMOSS-Team/MOSS-VL-Instruct-0708 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("OpenMOSS-Team/MOSS-VL-Instruct-0708", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -114,10 +114,10 @@ model = AutoModelForCausalLM.from_pretrained(
|
|
| 114 |
)
|
| 115 |
```
|
| 116 |
|
| 117 |
-
|
| 118 |
-
<summary><b>Run Inference</b></summary>
|
| 119 |
|
| 120 |
-
|
|
|
|
| 121 |
|
| 122 |
```python
|
| 123 |
image_path = "data/example_image.jpg"
|
|
@@ -147,7 +147,10 @@ text = model.offline_image_generate(
|
|
| 147 |
print(text)
|
| 148 |
```
|
| 149 |
|
| 150 |
-
|
|
|
|
|
|
|
|
|
|
| 151 |
|
| 152 |
```python
|
| 153 |
video_path = "data/example_video.mp4"
|
|
@@ -181,7 +184,10 @@ text = model.offline_video_generate(
|
|
| 181 |
print(text)
|
| 182 |
```
|
| 183 |
|
| 184 |
-
|
|
|
|
|
|
|
|
|
|
| 185 |
|
| 186 |
`offline_batch_generate` accepts independent image/video/text queries. Queries in the same batch should share the same `media_kwargs` and `generate_kwargs`.
|
| 187 |
|
|
|
|
| 114 |
)
|
| 115 |
```
|
| 116 |
|
| 117 |
+
### Run Inference
|
|
|
|
| 118 |
|
| 119 |
+
<details>
|
| 120 |
+
<summary><b>Single-image Inference</b></summary>
|
| 121 |
|
| 122 |
```python
|
| 123 |
image_path = "data/example_image.jpg"
|
|
|
|
| 147 |
print(text)
|
| 148 |
```
|
| 149 |
|
| 150 |
+
</details>
|
| 151 |
+
|
| 152 |
+
<details>
|
| 153 |
+
<summary><b>Single-video Inference</b></summary>
|
| 154 |
|
| 155 |
```python
|
| 156 |
video_path = "data/example_video.mp4"
|
|
|
|
| 184 |
print(text)
|
| 185 |
```
|
| 186 |
|
| 187 |
+
</details>
|
| 188 |
+
|
| 189 |
+
<details>
|
| 190 |
+
<summary><b>Batched Offline Inference</b></summary>
|
| 191 |
|
| 192 |
`offline_batch_generate` accepts independent image/video/text queries. Queries in the same batch should share the same `media_kwargs` and `generate_kwargs`.
|
| 193 |
|