qaihm-bot commited on
Commit
08233b0
·
verified ·
1 Parent(s): 6b3aabd

See https://github.com/quic/ai-hub-models/releases/v0.47.0 for changelog.

Files changed (1) hide show
  1. README.md +12 -10
README.md CHANGED
@@ -27,8 +27,8 @@ Below are pre-exported model assets ready for deployment.
27
 
28
  | Runtime | Precision | Chipset | SDK Versions | Download |
29
  |---|---|---|---|---|
30
- | QNN_DLC | float | Universal | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/statetransformer/releases/v0.46.0/statetransformer-qnn_dlc-float.zip)
31
- | TFLITE | float | Universal | TFLite 2.17.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/statetransformer/releases/v0.46.0/statetransformer-tflite-float.zip)
32
 
33
  For more device-specific assets and performance metrics, visit **[StateTransformer on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/statetransformer)**.
34
 
@@ -57,14 +57,16 @@ See our repository for [StateTransformer on GitHub](https://github.com/quic/ai-h
57
  ## Performance Summary
58
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
59
  |---|---|---|---|---|---|---
60
- | StateTransformer | QNN_DLC | float | Snapdragon® X Elite | 4076.132 ms | 22 - 22 MB | NPU
61
- | StateTransformer | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 3326.654 ms | 11 - 3356 MB | NPU
62
- | StateTransformer | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 504.429 ms | 214 - 229 MB | CPU
63
- | StateTransformer | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 997.127 ms | 224 - 239 MB | CPU
64
- | StateTransformer | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 576.673 ms | 216 - 514 MB | CPU
65
- | StateTransformer | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 752.049 ms | 217 - 233 MB | CPU
66
- | StateTransformer | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 392.99 ms | 161 - 171 MB | CPU
67
- | StateTransformer | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 360.867 ms | 226 - 249 MB | CPU
 
 
68
 
69
  ## License
70
  * The license for the original implementation of StateTransformer can be found
 
27
 
28
  | Runtime | Precision | Chipset | SDK Versions | Download |
29
  |---|---|---|---|---|
30
+ | ONNX | float | Universal | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/statetransformer/releases/v0.47.0/statetransformer-onnx-float.zip)
31
+ | TFLITE | float | Universal | TFLite 2.17.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/statetransformer/releases/v0.47.0/statetransformer-tflite-float.zip)
32
 
33
  For more device-specific assets and performance metrics, visit **[StateTransformer on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/statetransformer)**.
34
 
 
57
  ## Performance Summary
58
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
59
  |---|---|---|---|---|---|---
60
+ | StateTransformer | ONNX | float | Snapdragon® X Elite | 1155.042 ms | 183 - 183 MB | NPU
61
+ | StateTransformer | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 680.781 ms | 97 - 5301 MB | NPU
62
+ | StateTransformer | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 591.948 ms | 89 - 2116 MB | NPU
63
+ | StateTransformer | ONNX | float | Snapdragon® X2 Elite | 817.45 ms | 202 - 202 MB | NPU
64
+ | StateTransformer | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 499.081 ms | 215 - 232 MB | CPU
65
+ | StateTransformer | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 1006.082 ms | 224 - 239 MB | CPU
66
+ | StateTransformer | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 619.001 ms | 216 - 315 MB | CPU
67
+ | StateTransformer | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 717.641 ms | 217 - 235 MB | CPU
68
+ | StateTransformer | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 401.824 ms | 214 - 224 MB | CPU
69
+ | StateTransformer | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 348.775 ms | 226 - 246 MB | CPU
70
 
71
  ## License
72
  * The license for the original implementation of StateTransformer can be found