Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -25,9 +25,13 @@ decoder once per click.
|
|
| 25 |
|
| 26 |
The encoder ships in fp32 only, and that is not an omission. Its backbone is RepViT,
|
| 27 |
which is convolutional, and XNNPACK serializes convolution weights as fp32 whatever
|
| 28 |
-
dtype the graph carries
|
| 29 |
-
|
| 30 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 31 |
|
| 32 |
EdgeTAM is Meta's on-device SAM 2 (CVPR 2025). Its encoder is **5.5× smaller than
|
| 33 |
SAM 2.1 hiera-tiny's** (19.7 MB vs 109.2 MB) for the same output contract, so an
|
|
@@ -80,13 +84,3 @@ the decoder are dropped, since their lowered form mis-sizes on a single-point ex
|
|
| 80 |
The GPU-specific rewrites in the LiteRT build of this model (splitting the
|
| 81 |
squeeze-excite mean, replacing ConvTranspose2d) are ML Drift workarounds and are not
|
| 82 |
needed here — XNNPACK runs the stock graph.
|
| 83 |
-
|
| 84 |
-
<!-- funnel:v1 -->
|
| 85 |
-
|
| 86 |
-
---
|
| 87 |
-
|
| 88 |
-
**More models in this format:** [ExecuTorch Model Zoo](https://huggingface.co/collections/mlboydaisuke/executorch-model-zoo-6a7ff328390b63075ffeae5e) — 31 models, each with the recipe that produced it.
|
| 89 |
-
|
| 90 |
-
**Want a different model on-device?** [Open a request](https://github.com/john-rocky/on-device-requests) — free, open weights only; the export and its measured numbers get published publicly.
|
| 91 |
-
|
| 92 |
-
<!-- /funnel:v1 -->
|
|
|
|
| 25 |
|
| 26 |
The encoder ships in fp32 only, and that is not an omission. Its backbone is RepViT,
|
| 27 |
which is convolutional, and XNNPACK serializes convolution weights as fp32 whatever
|
| 28 |
+
dtype the graph carries, so fp16 came out at 19.8 MB (100.5%) and buys nothing.
|
| 29 |
+
Dynamic int8 is a different matter: it annotates `aten.linear` and this graph has
|
| 30 |
+
none — all 50 nn.Linear in EdgeTAM sit in the mask decoder, not on the
|
| 31 |
+
image-embedding path — so it leaves the encoder at the same 19.7 MB. Static int8 is
|
| 32 |
+
the recipe that would reach convolution weights, and it has not been run here. At
|
| 33 |
+
19.7 MB the fp32 encoder is already smaller than SAM 2.1 hiera-tiny's *fp16* encoder
|
| 34 |
+
(55.6 MB).
|
| 35 |
|
| 36 |
EdgeTAM is Meta's on-device SAM 2 (CVPR 2025). Its encoder is **5.5× smaller than
|
| 37 |
SAM 2.1 hiera-tiny's** (19.7 MB vs 109.2 MB) for the same output contract, so an
|
|
|
|
| 84 |
The GPU-specific rewrites in the LiteRT build of this model (splitting the
|
| 85 |
squeeze-excite mean, replacing ConvTranspose2d) are ML Drift workarounds and are not
|
| 86 |
needed here — XNNPACK runs the stock graph.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|