Align patch_size between image and video processing
Browse filesImage processor uses `patch_size=2` but video processor has `patch_size=16`. This misalignment leads to error (`RuntimeError: mat1 and mat2 shapes cannot be multiplied (20160x768 and 12x8)`) when running the model with transformers and video input.
- processor_config.json +1 -1
processor_config.json
CHANGED
|
@@ -69,7 +69,7 @@
|
|
| 69 |
],
|
| 70 |
"max_soft_tokens": 70,
|
| 71 |
"num_frames": 32,
|
| 72 |
-
"patch_size":
|
| 73 |
"pooling_kernel_size": 3,
|
| 74 |
"resample": 3,
|
| 75 |
"rescale_factor": 0.00392156862745098,
|
|
|
|
| 69 |
],
|
| 70 |
"max_soft_tokens": 70,
|
| 71 |
"num_frames": 32,
|
| 72 |
+
"patch_size": 2,
|
| 73 |
"pooling_kernel_size": 3,
|
| 74 |
"resample": 3,
|
| 75 |
"rescale_factor": 0.00392156862745098,
|