YOLOv8-Detection: Optimized for Qualcomm Devices

Ultralytics YOLOv8 is a machine learning model that predicts bounding boxes and classes of objects in an image.

This is based on the implementation of YOLOv8-Detection found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

Due to licensing restrictions, we cannot distribute pre-exported model assets for this model. Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

See our repository for YOLOv8-Detection on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.object_detection

Model Stats:

  • Input resolution: 640x640
  • Model checkpoint: YOLOv8-N
  • Model size (float): 12.2 MB
  • Model size (w8a16): 3.60 MB
  • Model size (w8a8): 3.25 MB
  • Number of parameters: 3.18M

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
YOLOv8-Detection ONNX float Snapdragon® X2 Elite 3.123 ms 5 - 5 MB NPU
YOLOv8-Detection ONNX float Snapdragon® X Elite 6.522 ms 5 - 5 MB NPU
YOLOv8-Detection ONNX float Snapdragon® 8 Gen 3 Mobile 5.377 ms 5 - 225 MB NPU
YOLOv8-Detection ONNX float Snapdragon® 8 Gen 1 Mobile 13.516 ms 5 - 200 MB NPU
YOLOv8-Detection ONNX float Qualcomm® Dragonwing™ IQ-8275 8.301 ms 5 - 8 MB NPU
YOLOv8-Detection ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 6.872 ms 5 - 12 MB NPU
YOLOv8-Detection ONNX float Qualcomm® QCS8450 13.516 ms 5 - 200 MB NPU
YOLOv8-Detection ONNX float Qualcomm® Dragonwing™ IQ-9075 8.084 ms 5 - 7 MB NPU
YOLOv8-Detection ONNX float Qualcomm® Dragonwing™ IQ-X7181 6.522 ms 5 - 5 MB NPU
YOLOv8-Detection ONNX float Qualcomm® Dragonwing™ Q-8750 4.249 ms 0 - 196 MB NPU
YOLOv8-Detection ONNX float Snapdragon® 8 Elite Mobile 4.249 ms 0 - 196 MB NPU
YOLOv8-Detection ONNX float Snapdragon® 8 Elite Gen 5 Mobile 2.834 ms 0 - 215 MB NPU
YOLOv8-Detection ONNX w8a16 Snapdragon® X2 Elite 2.363 ms 2 - 2 MB NPU
YOLOv8-Detection ONNX w8a16 Snapdragon® X Elite 5.032 ms 1 - 1 MB NPU
YOLOv8-Detection ONNX w8a16 Snapdragon® 8 Gen 3 Mobile 2.915 ms 0 - 93 MB NPU
YOLOv8-Detection ONNX w8a16 Snapdragon® 8 Gen 1 Mobile 6.12 ms 3 - 94 MB NPU
YOLOv8-Detection ONNX w8a16 Qualcomm® Dragonwing™ QCS6490 15.56 ms 2 - 5 MB NPU
YOLOv8-Detection ONNX w8a16 Qualcomm® Dragonwing™ IQ-8275 4.268 ms 2 - 6 MB NPU
YOLOv8-Detection ONNX w8a16 Qualcomm® Dragonwing™ QCS8550 (Proxy) 4.79 ms 2 - 6 MB NPU
YOLOv8-Detection ONNX w8a16 Qualcomm® QCS8450 6.12 ms 3 - 94 MB NPU
YOLOv8-Detection ONNX w8a16 Qualcomm® Dragonwing™ IQ-9075 5.212 ms 2 - 5 MB NPU
YOLOv8-Detection ONNX w8a16 Qualcomm® Dragonwing™ IQ-X7181 5.032 ms 1 - 1 MB NPU
YOLOv8-Detection ONNX w8a16 Qualcomm® Dragonwing™ Q-6690 26.621 ms 3 - 194 MB NPU
YOLOv8-Detection ONNX w8a16 Qualcomm® Dragonwing™ Q-7790 6.57 ms 3 - 184 MB NPU
YOLOv8-Detection ONNX w8a16 Qualcomm® Dragonwing™ Q-8750 2.234 ms 1 - 73 MB NPU
YOLOv8-Detection ONNX w8a16 Snapdragon® 8 Elite Mobile 2.234 ms 1 - 73 MB NPU
YOLOv8-Detection ONNX w8a16 Snapdragon® 8 Elite Gen 5 Mobile 2.026 ms 1 - 76 MB NPU
YOLOv8-Detection ONNX w8a16 Snapdragon® 7 Gen 4 Mobile 6.57 ms 3 - 184 MB NPU
YOLOv8-Detection ONNX w8a8 Snapdragon® X2 Elite 0.832 ms 1 - 1 MB NPU
YOLOv8-Detection ONNX w8a8 Snapdragon® X Elite 1.585 ms 0 - 0 MB NPU
YOLOv8-Detection ONNX w8a8 Snapdragon® 8 Gen 3 Mobile 1.012 ms 0 - 72 MB NPU
YOLOv8-Detection ONNX w8a8 Snapdragon® 8 Gen 1 Mobile 1.843 ms 0 - 70 MB NPU
YOLOv8-Detection ONNX w8a8 Qualcomm® Dragonwing™ QCS6490 10.721 ms 1 - 4 MB NPU
YOLOv8-Detection ONNX w8a8 Qualcomm® Dragonwing™ IQ-8275 1.583 ms 0 - 4 MB NPU
YOLOv8-Detection ONNX w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 1.519 ms 0 - 5 MB NPU
YOLOv8-Detection ONNX w8a8 Qualcomm® QCS8450 1.843 ms 0 - 70 MB NPU
YOLOv8-Detection ONNX w8a8 Qualcomm® Dragonwing™ IQ-9075 1.707 ms 0 - 3 MB NPU
YOLOv8-Detection ONNX w8a8 Qualcomm® Dragonwing™ IQ-X7181 1.585 ms 0 - 0 MB NPU
YOLOv8-Detection ONNX w8a8 Qualcomm® Dragonwing™ Q-6690 10.125 ms 1 - 171 MB NPU
YOLOv8-Detection ONNX w8a8 Qualcomm® Dragonwing™ Q-7790 1.894 ms 0 - 165 MB NPU
YOLOv8-Detection ONNX w8a8 Qualcomm® Dragonwing™ Q-8750 0.723 ms 0 - 53 MB NPU
YOLOv8-Detection ONNX w8a8 Snapdragon® 8 Elite Mobile 0.723 ms 0 - 53 MB NPU
YOLOv8-Detection ONNX w8a8 Snapdragon® 8 Elite Gen 5 Mobile 0.626 ms 0 - 54 MB NPU
YOLOv8-Detection ONNX w8a8 Snapdragon® 7 Gen 4 Mobile 1.894 ms 0 - 165 MB NPU
YOLOv8-Detection ONNX w8a8_mixed_int16 Snapdragon® X2 Elite 3.027 ms 2 - 2 MB NPU
YOLOv8-Detection ONNX w8a8_mixed_int16 Snapdragon® X Elite 6.662 ms 0 - 0 MB NPU
YOLOv8-Detection ONNX w8a8_mixed_int16 Snapdragon® 8 Gen 3 Mobile 4.275 ms 3 - 135 MB NPU
YOLOv8-Detection ONNX w8a8_mixed_int16 Qualcomm® Dragonwing™ IQ-8275 6.097 ms 2 - 6 MB NPU
YOLOv8-Detection ONNX w8a8_mixed_int16 Qualcomm® Dragonwing™ QCS8550 (Proxy) 6.291 ms 0 - 6 MB NPU
YOLOv8-Detection ONNX w8a8_mixed_int16 Qualcomm® Dragonwing™ IQ-9075 6.835 ms 2 - 5 MB NPU
YOLOv8-Detection ONNX w8a8_mixed_int16 Qualcomm® Dragonwing™ IQ-X7181 6.662 ms 0 - 0 MB NPU
YOLOv8-Detection ONNX w8a8_mixed_int16 Qualcomm® Dragonwing™ Q-8750 2.982 ms 0 - 101 MB NPU
YOLOv8-Detection ONNX w8a8_mixed_int16 Snapdragon® 8 Elite Mobile 2.982 ms 0 - 101 MB NPU
YOLOv8-Detection ONNX w8a8_mixed_int16 Snapdragon® 8 Elite Gen 5 Mobile 2.677 ms 2 - 117 MB NPU
YOLOv8-Detection QNN_DLC float Snapdragon® X2 Elite 2.995 ms 5 - 5 MB NPU
YOLOv8-Detection QNN_DLC float Snapdragon® X Elite 4.208 ms 5 - 5 MB NPU
YOLOv8-Detection QNN_DLC float Snapdragon® 8 Gen 3 Mobile 2.778 ms 5 - 214 MB NPU
YOLOv8-Detection QNN_DLC float Snapdragon® 8 Gen 1 Mobile 7.736 ms 5 - 193 MB NPU
YOLOv8-Detection QNN_DLC float Qualcomm® Dragonwing™ IQ-8275 5.085 ms 5 - 12 MB NPU
YOLOv8-Detection QNN_DLC float Qualcomm® Dragonwing™ IQ-8275 13.695 ms 0 - 185 MB NPU
YOLOv8-Detection QNN_DLC float Qualcomm® Dragonwing™ QCS8550 (Proxy) 3.798 ms 5 - 7 MB NPU
YOLOv8-Detection QNN_DLC float Qualcomm® SA8775P 5.298 ms 0 - 188 MB NPU
YOLOv8-Detection QNN_DLC float Qualcomm® SA8650P 5.298 ms 0 - 188 MB NPU
YOLOv8-Detection QNN_DLC float Qualcomm® SA8255P 5.298 ms 0 - 188 MB NPU
YOLOv8-Detection QNN_DLC float Qualcomm® QCS8450 7.736 ms 5 - 193 MB NPU
YOLOv8-Detection QNN_DLC float Qualcomm® Dragonwing™ IQ-9075 5.087 ms 5 - 11 MB NPU
YOLOv8-Detection QNN_DLC float Qualcomm® Dragonwing™ IQ-X7181 4.208 ms 5 - 5 MB NPU
YOLOv8-Detection QNN_DLC float Qualcomm® Dragonwing™ Q-8750 2.093 ms 5 - 192 MB NPU
YOLOv8-Detection QNN_DLC float Qualcomm® SA7255P 13.695 ms 0 - 185 MB NPU
YOLOv8-Detection QNN_DLC float Qualcomm® SA8295P 7.905 ms 2 - 164 MB NPU
YOLOv8-Detection QNN_DLC float Snapdragon® 8 Elite Mobile 2.093 ms 5 - 192 MB NPU
YOLOv8-Detection QNN_DLC float Snapdragon® 8 Elite Gen 5 Mobile 1.852 ms 5 - 199 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Snapdragon® X2 Elite 1.67 ms 2 - 2 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Snapdragon® X Elite 3.754 ms 2 - 2 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Snapdragon® 8 Gen 3 Mobile 2.241 ms 2 - 69 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Snapdragon® 8 Gen 1 Mobile 4.037 ms 2 - 75 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Qualcomm® Dragonwing™ QCS6490 12.291 ms 1 - 5 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-8275 3.255 ms 2 - 6 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-8275 6.708 ms 1 - 52 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Qualcomm® Dragonwing™ QCS8550 (Proxy) 3.335 ms 2 - 18 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Qualcomm® SA8775P 3.907 ms 1 - 54 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Qualcomm® SA8650P 3.907 ms 1 - 54 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Qualcomm® SA8255P 3.907 ms 1 - 54 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Qualcomm® QCS8450 4.037 ms 2 - 75 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-9075 3.657 ms 1 - 5 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-X7181 3.754 ms 2 - 2 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-6690 21.833 ms 2 - 172 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-7790 4.55 ms 2 - 169 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-8750 1.537 ms 2 - 55 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Qualcomm® SA7255P 6.708 ms 1 - 52 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Qualcomm® SA8295P 4.593 ms 0 - 48 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Snapdragon® 8 Elite Mobile 1.537 ms 2 - 55 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Snapdragon® 8 Elite Gen 5 Mobile 1.245 ms 2 - 61 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Snapdragon® 7 Gen 4 Mobile 4.55 ms 2 - 169 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Snapdragon® X2 Elite 0.829 ms 1 - 1 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Snapdragon® X Elite 1.578 ms 1 - 1 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Snapdragon® 8 Gen 3 Mobile 0.95 ms 1 - 52 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Snapdragon® 8 Gen 1 Mobile 1.628 ms 1 - 55 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Qualcomm® Dragonwing™ QCS6490 4.494 ms 1 - 4 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-8275 1.448 ms 1 - 5 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-8275 3.211 ms 1 - 37 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 1.384 ms 2 - 3 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Qualcomm® SA8775P 1.775 ms 0 - 39 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Qualcomm® SA8650P 1.775 ms 0 - 39 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Qualcomm® SA8255P 1.775 ms 0 - 39 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Qualcomm® QCS8450 1.628 ms 1 - 55 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-9075 1.562 ms 1 - 4 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-X7181 1.578 ms 1 - 1 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-6690 8.428 ms 1 - 156 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-7790 1.486 ms 1 - 38 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-8750 0.683 ms 0 - 40 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Qualcomm® SA7255P 3.211 ms 1 - 37 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Qualcomm® SA8295P 2.212 ms 0 - 34 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Snapdragon® 8 Elite Mobile 0.683 ms 0 - 40 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Snapdragon® 8 Elite Gen 5 Mobile 0.588 ms 1 - 39 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Snapdragon® 7 Gen 4 Mobile 1.486 ms 1 - 38 MB NPU
YOLOv8-Detection TFLITE float Snapdragon® 8 Gen 3 Mobile 2.468 ms 0 - 107 MB NPU
YOLOv8-Detection TFLITE float Snapdragon® 8 Gen 1 Mobile 6.511 ms 0 - 81 MB NPU
YOLOv8-Detection TFLITE float Qualcomm® Dragonwing™ IQ-8275 4.721 ms 0 - 15 MB NPU
YOLOv8-Detection TFLITE float Qualcomm® Dragonwing™ IQ-8275 13.11 ms 0 - 75 MB NPU
YOLOv8-Detection TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 3.362 ms 0 - 4 MB NPU
YOLOv8-Detection TFLITE float Qualcomm® SA8775P 5.007 ms 0 - 85 MB NPU
YOLOv8-Detection TFLITE float Qualcomm® SA8650P 5.007 ms 0 - 85 MB NPU
YOLOv8-Detection TFLITE float Qualcomm® SA8255P 5.007 ms 0 - 85 MB NPU
YOLOv8-Detection TFLITE float Qualcomm® QCS8450 6.511 ms 0 - 81 MB NPU
YOLOv8-Detection TFLITE float Qualcomm® Dragonwing™ IQ-9075 4.772 ms 0 - 14 MB NPU
YOLOv8-Detection TFLITE float Qualcomm® Dragonwing™ Q-8750 1.868 ms 0 - 90 MB NPU
YOLOv8-Detection TFLITE float Qualcomm® SA7255P 13.11 ms 0 - 75 MB NPU
YOLOv8-Detection TFLITE float Qualcomm® SA8295P 7.333 ms 0 - 53 MB NPU
YOLOv8-Detection TFLITE float Snapdragon® 8 Elite Mobile 1.868 ms 0 - 90 MB NPU
YOLOv8-Detection TFLITE float Snapdragon® 8 Elite Gen 5 Mobile 1.498 ms 0 - 87 MB NPU
YOLOv8-Detection TFLITE w8a8 Snapdragon® 8 Gen 3 Mobile 0.897 ms 0 - 50 MB NPU
YOLOv8-Detection TFLITE w8a8 Snapdragon® 8 Gen 1 Mobile 1.603 ms 0 - 53 MB NPU
YOLOv8-Detection TFLITE w8a8 Qualcomm® Dragonwing™ QCS6490 4.227 ms 0 - 7 MB NPU
YOLOv8-Detection TFLITE w8a8 Qualcomm® Dragonwing™ IQ-8275 1.404 ms 0 - 7 MB NPU
YOLOv8-Detection TFLITE w8a8 Qualcomm® Dragonwing™ IQ-8275 3.047 ms 0 - 35 MB NPU
YOLOv8-Detection TFLITE w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 1.303 ms 0 - 2 MB NPU
YOLOv8-Detection TFLITE w8a8 Qualcomm® SA8775P 1.694 ms 0 - 39 MB NPU
YOLOv8-Detection TFLITE w8a8 Qualcomm® SA8650P 1.694 ms 0 - 39 MB NPU
YOLOv8-Detection TFLITE w8a8 Qualcomm® SA8255P 1.694 ms 0 - 39 MB NPU
YOLOv8-Detection TFLITE w8a8 Qualcomm® QCS8450 1.603 ms 0 - 53 MB NPU
YOLOv8-Detection TFLITE w8a8 Qualcomm® Dragonwing™ IQ-9075 1.501 ms 0 - 7 MB NPU
YOLOv8-Detection TFLITE w8a8 Qualcomm® Dragonwing™ Q-6690 8.4 ms 0 - 155 MB NPU
YOLOv8-Detection TFLITE w8a8 Qualcomm® Dragonwing™ Q-7790 1.435 ms 0 - 35 MB NPU
YOLOv8-Detection TFLITE w8a8 Qualcomm® Dragonwing™ Q-8750 0.649 ms 0 - 34 MB NPU
YOLOv8-Detection TFLITE w8a8 Qualcomm® SA7255P 3.047 ms 0 - 35 MB NPU
YOLOv8-Detection TFLITE w8a8 Qualcomm® SA8295P 2.13 ms 0 - 34 MB NPU
YOLOv8-Detection TFLITE w8a8 Snapdragon® 8 Elite Mobile 0.649 ms 0 - 34 MB NPU
YOLOv8-Detection TFLITE w8a8 Snapdragon® 8 Elite Gen 5 Mobile 0.577 ms 0 - 37 MB NPU
YOLOv8-Detection TFLITE w8a8 Snapdragon® 7 Gen 4 Mobile 1.435 ms 0 - 35 MB NPU

License

  • The license for the original implementation of YOLOv8-Detection can be found here.

References

Community

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support