qaihm-bot commited on
Commit
9b33c04
·
verified ·
1 Parent(s): 4f9978c

See https://github.com/qualcomm/ai-hub-models/releases/v0.49.1 for changelog.

Files changed (1) hide show
  1. README.md +103 -103
README.md CHANGED
@@ -28,26 +28,26 @@ Below are pre-exported model assets ready for deployment.
28
 
29
  | Runtime | Precision | Chipset | SDK Versions | Download |
30
  |---|---|---|---|---|
31
- | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X2 Elite | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.48.0/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_snapdragon_x2_elite.zip)
32
- | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X Elite | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.48.0/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_snapdragon_x_elite.zip)
33
- | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.48.0/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_snapdragon_8gen3.zip)
34
- | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.48.0/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_qcs8550_proxy.zip)
35
- | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.48.0/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_snapdragon_8_elite_for_galaxy.zip)
36
- | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.48.0/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_snapdragon_7gen4.zip)
37
- | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.48.0/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_snapdragon_8_elite_gen5.zip)
38
- | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCM6690 | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.48.0/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_qcm6690.zip)
39
- | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS9075 | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.48.0/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_qcs9075.zip)
40
- | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X2 Elite | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.48.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_snapdragon_x2_elite.zip)
41
- | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X Elite | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.48.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_snapdragon_x_elite.zip)
42
- | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Gen 3 Mobile | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.48.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_snapdragon_8gen3.zip)
43
- | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8550 (Proxy) | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.48.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_qcs8550_proxy.zip)
44
- | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA8775P | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.48.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_sa8775p.zip)
45
- | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.48.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_snapdragon_8_elite_for_galaxy.zip)
46
- | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 7 Gen 4 Mobile | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.48.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_snapdragon_7gen4.zip)
47
- | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.48.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_snapdragon_8_elite_gen5.zip)
48
- | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA7255P | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.48.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_sa7255p.zip)
49
- | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCM6690 | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.48.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_qcm6690.zip)
50
- | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS9075 | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.48.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_qcs9075.zip)
51
 
52
  For more device-specific assets and performance metrics, visit **[ControlNet-Canny on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/controlnet_canny)**.
53
 
@@ -79,90 +79,90 @@ See our repository for [ControlNet-Canny on GitHub](https://github.com/qualcomm/
79
  ## Performance Summary
80
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
81
  |---|---|---|---|---|---|---
82
- | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X2 Elite | 28.57 ms | 351 - 351 MB | NPU
83
- | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X Elite | 75.919 ms | 351 - 351 MB | NPU
84
- | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 62.95 ms | 33 - 40 MB | NPU
85
- | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 82.894 ms | 30 - 32 MB | NPU
86
- | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS9075 | 74.95 ms | 30 - 34 MB | NPU
87
- | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCM6690 | 1116.768 ms | 0 - 10 MB | NPU
88
- | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 49.136 ms | 32 - 44 MB | NPU
89
- | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 123.48 ms | 33 - 43 MB | NPU
90
- | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 28.479 ms | 31 - 41 MB | NPU
91
- | controlnet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X2 Elite | 29.665 ms | 2 - 2 MB | NPU
92
- | controlnet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X Elite | 75.951 ms | 2 - 2 MB | NPU
93
- | controlnet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Gen 3 Mobile | 59.616 ms | 2 - 9 MB | NPU
94
- | controlnet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8275 (Proxy) | 141.351 ms | 2 - 9 MB | NPU
95
- | controlnet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8550 (Proxy) | 82.19 ms | 2 - 3 MB | NPU
96
- | controlnet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA8775P | 77.754 ms | 2 - 11 MB | NPU
97
- | controlnet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS9075 | 76.425 ms | 1 - 17 MB | NPU
98
- | controlnet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCM6690 | 1229.237 ms | 0 - 6 MB | NPU
99
- | controlnet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA7255P | 141.351 ms | 2 - 9 MB | NPU
100
- | controlnet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 47.178 ms | 2 - 11 MB | NPU
101
- | controlnet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 7 Gen 4 Mobile | 121.427 ms | 0 - 6 MB | NPU
102
- | controlnet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 28.68 ms | 2 - 12 MB | NPU
103
- | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X2 Elite | 1.527 ms | 156 - 156 MB | NPU
104
- | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X Elite | 3.635 ms | 156 - 156 MB | NPU
105
- | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 2.304 ms | 0 - 10 MB | NPU
106
- | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 3.253 ms | 0 - 161 MB | NPU
107
- | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS9075 | 3.324 ms | 0 - 3 MB | NPU
108
- | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCM6690 | 24.818 ms | 0 - 10 MB | NPU
109
- | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 1.758 ms | 0 - 11 MB | NPU
110
- | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 3.645 ms | 0 - 6 MB | NPU
111
- | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 1.49 ms | 0 - 10 MB | NPU
112
- | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X2 Elite | 1.77 ms | 0 - 0 MB | NPU
113
- | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X Elite | 3.627 ms | 0 - 0 MB | NPU
114
- | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Gen 3 Mobile | 2.336 ms | 0 - 7 MB | NPU
115
- | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8275 (Proxy) | 7.529 ms | 0 - 8 MB | NPU
116
- | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8550 (Proxy) | 3.252 ms | 0 - 1 MB | NPU
117
- | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA8775P | 3.485 ms | 0 - 9 MB | NPU
118
- | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS9075 | 3.35 ms | 0 - 2 MB | NPU
119
- | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCM6690 | 21.916 ms | 0 - 6 MB | NPU
120
- | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA7255P | 7.529 ms | 0 - 8 MB | NPU
121
- | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 1.754 ms | 0 - 10 MB | NPU
122
- | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 7 Gen 4 Mobile | 3.662 ms | 0 - 7 MB | NPU
123
  | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 1.493 ms | 0 - 9 MB | NPU
124
- | unet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X2 Elite | 48.655 ms | 832 - 832 MB | NPU
125
- | unet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X Elite | 114.281 ms | 829 - 829 MB | NPU
126
- | unet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 81.51 ms | 13 - 25 MB | NPU
127
- | unet | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 112.442 ms | 0 - 883 MB | NPU
128
- | unet | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS9075 | 106.412 ms | 13 - 29 MB | NPU
129
- | unet | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCM6690 | 2174.57 ms | 13 - 24 MB | NPU
130
- | unet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 61.974 ms | 6 - 17 MB | NPU
131
- | unet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 180.905 ms | 13 - 24 MB | NPU
132
- | unet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 45.331 ms | 13 - 21 MB | NPU
133
- | unet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X2 Elite | 46.423 ms | 13 - 13 MB | NPU
134
- | unet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X Elite | 113.562 ms | 13 - 13 MB | NPU
135
- | unet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Gen 3 Mobile | 80.616 ms | 13 - 21 MB | NPU
136
- | unet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8275 (Proxy) | 266.683 ms | 6 - 12 MB | NPU
137
- | unet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8550 (Proxy) | 108.831 ms | 13 - 15 MB | NPU
138
- | unet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA8775P | 107.797 ms | 8 - 15 MB | NPU
139
- | unet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS9075 | 107.21 ms | 3 - 17 MB | NPU
140
- | unet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCM6690 | 2130.306 ms | 13 - 24 MB | NPU
141
- | unet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA7255P | 266.683 ms | 6 - 12 MB | NPU
142
- | unet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 62.938 ms | 6 - 18 MB | NPU
143
- | unet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 7 Gen 4 Mobile | 181.177 ms | 10 - 16 MB | NPU
144
- | unet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 45.967 ms | 13 - 22 MB | NPU
145
- | vae | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X2 Elite | 124.657 ms | 62 - 62 MB | NPU
146
- | vae | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X Elite | 266.097 ms | 62 - 62 MB | NPU
147
- | vae | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 203.541 ms | 3 - 10 MB | NPU
148
- | vae | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 272.146 ms | 1 - 66 MB | NPU
149
- | vae | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS9075 | 250.433 ms | 3 - 6 MB | NPU
150
- | vae | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCM6690 | 6320.471 ms | 0 - 6 MB | NPU
151
- | vae | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 177.383 ms | 3 - 11 MB | NPU
152
- | vae | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 512.887 ms | 2 - 8 MB | NPU
153
- | vae | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 116.672 ms | 3 - 13 MB | NPU
154
- | vae | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X2 Elite | 132.981 ms | 0 - 0 MB | NPU
155
- | vae | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X Elite | 262.707 ms | 0 - 0 MB | NPU
156
- | vae | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Gen 3 Mobile | 203.119 ms | 0 - 8 MB | NPU
157
- | vae | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8275 (Proxy) | 720.07 ms | 0 - 9 MB | NPU
158
- | vae | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8550 (Proxy) | 266.87 ms | 1 - 2 MB | NPU
159
- | vae | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA8775P | 250.629 ms | 0 - 9 MB | NPU
160
- | vae | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS9075 | 247.589 ms | 0 - 3 MB | NPU
161
- | vae | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCM6690 | 6413.086 ms | 0 - 7 MB | NPU
162
- | vae | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA7255P | 720.07 ms | 0 - 9 MB | NPU
163
- | vae | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 176.765 ms | 0 - 9 MB | NPU
164
- | vae | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 7 Gen 4 Mobile | 514.864 ms | 0 - 6 MB | NPU
165
- | vae | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 128.525 ms | 0 - 10 MB | NPU
 
 
 
 
 
 
 
 
 
 
 
166
 
167
  ## License
168
  * The license for the original implementation of ControlNet-Canny can be found
 
28
 
29
  | Runtime | Precision | Chipset | SDK Versions | Download |
30
  |---|---|---|---|---|
31
+ | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.49.1/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_snapdragon_8_elite_gen5.zip)
32
+ | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X2 Elite | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.49.1/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_snapdragon_x2_elite.zip)
33
+ | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X Elite | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.49.1/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_snapdragon_x_elite.zip)
34
+ | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.49.1/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_snapdragon_8gen3.zip)
35
+ | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.49.1/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_qcs8550_proxy.zip)
36
+ | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.49.1/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_snapdragon_8_elite_for_galaxy.zip)
37
+ | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.49.1/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_snapdragon_7gen4.zip)
38
+ | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCM6690 | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.49.1/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_qcm6690.zip)
39
+ | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS9075 | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.49.1/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_qcs9075.zip)
40
+ | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.49.1/controlnet_canny-qnn_context_binary-w8a16-qualcomm_snapdragon_8_elite_gen5.zip)
41
+ | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X2 Elite | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.49.1/controlnet_canny-qnn_context_binary-w8a16-qualcomm_snapdragon_x2_elite.zip)
42
+ | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X Elite | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.49.1/controlnet_canny-qnn_context_binary-w8a16-qualcomm_snapdragon_x_elite.zip)
43
+ | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Gen 3 Mobile | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.49.1/controlnet_canny-qnn_context_binary-w8a16-qualcomm_snapdragon_8gen3.zip)
44
+ | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8550 (Proxy) | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.49.1/controlnet_canny-qnn_context_binary-w8a16-qualcomm_qcs8550_proxy.zip)
45
+ | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA8775P | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.49.1/controlnet_canny-qnn_context_binary-w8a16-qualcomm_sa8775p.zip)
46
+ | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.49.1/controlnet_canny-qnn_context_binary-w8a16-qualcomm_snapdragon_8_elite_for_galaxy.zip)
47
+ | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 7 Gen 4 Mobile | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.49.1/controlnet_canny-qnn_context_binary-w8a16-qualcomm_snapdragon_7gen4.zip)
48
+ | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA7255P | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.49.1/controlnet_canny-qnn_context_binary-w8a16-qualcomm_sa7255p.zip)
49
+ | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCM6690 | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.49.1/controlnet_canny-qnn_context_binary-w8a16-qualcomm_qcm6690.zip)
50
+ | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS9075 | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.49.1/controlnet_canny-qnn_context_binary-w8a16-qualcomm_qcs9075.zip)
51
 
52
  For more device-specific assets and performance metrics, visit **[ControlNet-Canny on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/controlnet_canny)**.
53
 
 
79
  ## Performance Summary
80
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
81
  |---|---|---|---|---|---|---
82
+ | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 28.336 ms | 31 - 41 MB | NPU
83
+ | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X2 Elite | 28.501 ms | 351 - 351 MB | NPU
84
+ | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X Elite | 76.056 ms | 351 - 351 MB | NPU
85
+ | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 61.637 ms | 33 - 46 MB | NPU
86
+ | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 82.896 ms | 30 - 32 MB | NPU
87
+ | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS9075 | 75.852 ms | 30 - 34 MB | NPU
88
+ | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCM6690 | 1063.912 ms | 2 - 13 MB | NPU
89
+ | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 45.185 ms | 33 - 43 MB | NPU
90
+ | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 124.515 ms | 31 - 42 MB | NPU
91
+ | controlnet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 28.347 ms | 2 - 12 MB | NPU
92
+ | controlnet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X2 Elite | 29.436 ms | 2 - 2 MB | NPU
93
+ | controlnet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X Elite | 76.012 ms | 2 - 2 MB | NPU
94
+ | controlnet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Gen 3 Mobile | 60.725 ms | 2 - 9 MB | NPU
95
+ | controlnet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8275 (Proxy) | 141.54 ms | 2 - 9 MB | NPU
96
+ | controlnet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8550 (Proxy) | 82.486 ms | 2 - 16 MB | NPU
97
+ | controlnet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA8775P | 305.49 ms | 2 - 9 MB | NPU
98
+ | controlnet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS9075 | 76.281 ms | 0 - 16 MB | NPU
99
+ | controlnet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCM6690 | 913.595 ms | 2 - 8 MB | NPU
100
+ | controlnet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA7255P | 141.54 ms | 2 - 9 MB | NPU
101
+ | controlnet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 47.93 ms | 2 - 10 MB | NPU
102
+ | controlnet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 7 Gen 4 Mobile | 122.561 ms | 2 - 8 MB | NPU
103
+ | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 1.494 ms | 0 - 10 MB | NPU
104
+ | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X2 Elite | 1.528 ms | 156 - 156 MB | NPU
105
+ | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X Elite | 3.618 ms | 156 - 156 MB | NPU
106
+ | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 2.298 ms | 0 - 10 MB | NPU
107
+ | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 3.247 ms | 0 - 161 MB | NPU
108
+ | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS9075 | 3.331 ms | 0 - 3 MB | NPU
109
+ | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCM6690 | 22.101 ms | 0 - 10 MB | NPU
110
+ | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 1.756 ms | 0 - 13 MB | NPU
111
+ | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 3.635 ms | 0 - 6 MB | NPU
 
 
 
 
 
 
 
 
 
 
 
112
  | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 1.493 ms | 0 - 9 MB | NPU
113
+ | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X2 Elite | 1.783 ms | 0 - 0 MB | NPU
114
+ | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X Elite | 3.627 ms | 0 - 0 MB | NPU
115
+ | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Gen 3 Mobile | 2.323 ms | 0 - 7 MB | NPU
116
+ | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8275 (Proxy) | 7.545 ms | 0 - 8 MB | NPU
117
+ | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8550 (Proxy) | 3.25 ms | 0 - 1 MB | NPU
118
+ | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA8775P | 3.524 ms | 0 - 9 MB | NPU
119
+ | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS9075 | 3.364 ms | 0 - 2 MB | NPU
120
+ | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCM6690 | 21.98 ms | 0 - 6 MB | NPU
121
+ | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA7255P | 7.545 ms | 0 - 8 MB | NPU
122
+ | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 1.745 ms | 0 - 13 MB | NPU
123
+ | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 7 Gen 4 Mobile | 3.65 ms | 0 - 7 MB | NPU
124
+ | unet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 45.448 ms | 13 - 21 MB | NPU
125
+ | unet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X2 Elite | 48.612 ms | 831 - 831 MB | NPU
126
+ | unet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X Elite | 114.377 ms | 829 - 829 MB | NPU
127
+ | unet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 80.413 ms | 13 - 25 MB | NPU
128
+ | unet | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 113.125 ms | 0 - 882 MB | NPU
129
+ | unet | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS9075 | 106.688 ms | 13 - 29 MB | NPU
130
+ | unet | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCM6690 | 2162.771 ms | 13 - 24 MB | NPU
131
+ | unet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 61.943 ms | 6 - 17 MB | NPU
132
+ | unet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 180.235 ms | 9 - 20 MB | NPU
133
+ | unet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 44.689 ms | 13 - 22 MB | NPU
134
+ | unet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X2 Elite | 46.58 ms | 13 - 13 MB | NPU
135
+ | unet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X Elite | 113.532 ms | 13 - 13 MB | NPU
136
+ | unet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Gen 3 Mobile | 80.842 ms | 13 - 20 MB | NPU
137
+ | unet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8275 (Proxy) | 266.779 ms | 0 - 6 MB | NPU
138
+ | unet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8550 (Proxy) | 112.27 ms | 13 - 15 MB | NPU
139
+ | unet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA8775P | 107.75 ms | 7 - 14 MB | NPU
140
+ | unet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS9075 | 107.147 ms | 11 - 25 MB | NPU
141
+ | unet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCM6690 | 2123.069 ms | 13 - 24 MB | NPU
142
+ | unet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA7255P | 266.779 ms | 0 - 6 MB | NPU
143
+ | unet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 61.944 ms | 6 - 15 MB | NPU
144
+ | unet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 7 Gen 4 Mobile | 181.03 ms | 10 - 16 MB | NPU
145
+ | vae | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 117.124 ms | 3 - 13 MB | NPU
146
+ | vae | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X2 Elite | 125.582 ms | 62 - 62 MB | NPU
147
+ | vae | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X Elite | 266.276 ms | 62 - 62 MB | NPU
148
+ | vae | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 203.046 ms | 3 - 10 MB | NPU
149
+ | vae | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 270.802 ms | 1 - 66 MB | NPU
150
+ | vae | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS9075 | 250.059 ms | 3 - 6 MB | NPU
151
+ | vae | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCM6690 | 6369.029 ms | 0 - 6 MB | NPU
152
+ | vae | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 178.953 ms | 3 - 10 MB | NPU
153
+ | vae | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 513.926 ms | 1 - 8 MB | NPU
154
+ | vae | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 130.322 ms | 0 - 10 MB | NPU
155
+ | vae | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X2 Elite | 133.418 ms | 0 - 0 MB | NPU
156
+ | vae | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X Elite | 262.733 ms | 0 - 0 MB | NPU
157
+ | vae | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Gen 3 Mobile | 203.185 ms | 0 - 8 MB | NPU
158
+ | vae | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8275 (Proxy) | 718.469 ms | 0 - 9 MB | NPU
159
+ | vae | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8550 (Proxy) | 267.018 ms | 1 - 3 MB | NPU
160
+ | vae | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA8775P | 250.474 ms | 0 - 9 MB | NPU
161
+ | vae | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS9075 | 247.311 ms | 0 - 3 MB | NPU
162
+ | vae | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCM6690 | 6429.227 ms | 1 - 7 MB | NPU
163
+ | vae | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA7255P | 718.469 ms | 0 - 9 MB | NPU
164
+ | vae | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 177.535 ms | 0 - 14 MB | NPU
165
+ | vae | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 7 Gen 4 Mobile | 514.686 ms | 0 - 6 MB | NPU
166
 
167
  ## License
168
  * The license for the original implementation of ControlNet-Canny can be found