Detectron2-Detection: Optimized for Qualcomm Devices

Detectron2-Detection is a machine learning model that can detect objects (trained on COCO dataset).

This is based on the implementation of Detectron2-Detection found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

There are two ways to deploy this model on your device:

Option 1: Download Pre-Exported Models

Below are pre-exported model assets ready for deployment.

Runtime Precision Chipset SDK Versions Download
ONNX float Universal QAIRT 2.42, ONNX Runtime 1.24.3 Download
ONNX w8a16 Universal QAIRT 2.42, ONNX Runtime 1.24.3 Download
ONNX w8a8 Universal QAIRT 2.42, ONNX Runtime 1.24.3 Download
QNN_DLC float Universal QAIRT 2.45 Download
QNN_DLC w8a16 Universal QAIRT 2.45 Download
QNN_DLC w8a8 Universal QAIRT 2.45 Download
TFLITE w8a8 Universal QAIRT 2.45 Download

For more device-specific assets and performance metrics, visit Detectron2-Detection on Qualcomm® AI Hub.

Option 2: Export with Custom Configurations

Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

This option is ideal if you need to customize the model beyond the default configuration provided here.

See our repository for Detectron2-Detection on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.object_detection

Model Stats:

  • Model checkpoint: faster_rcnn_R_50_C4_1x
  • Input resolution: 800x800
  • Number of parameters: 33.8M
  • Model size (float): 129 MB

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
proposal_generator ONNX float Snapdragon® 8 Elite Gen 5 Mobile 14.764 ms 35 - 492 MB NPU
proposal_generator ONNX float Snapdragon® X2 Elite 15.275 ms 65 - 65 MB NPU
proposal_generator ONNX float Snapdragon® X Elite 32.041 ms 66 - 66 MB NPU
proposal_generator ONNX float Snapdragon® 8 Gen 3 Mobile 24.126 ms 3 - 538 MB NPU
proposal_generator ONNX float Qualcomm® QCS8550 (Proxy) 32.084 ms 11 - 46 MB NPU
proposal_generator ONNX float Qualcomm® QCS9075 59.183 ms 7 - 17 MB NPU
proposal_generator ONNX float Snapdragon® 8 Elite For Galaxy Mobile 19.048 ms 2 - 444 MB NPU
proposal_generator ONNX w8a16 Snapdragon® 8 Elite Gen 5 Mobile 8.533 ms 10 - 509 MB NPU
proposal_generator ONNX w8a16 Snapdragon® X2 Elite 9.79 ms 35 - 35 MB NPU
proposal_generator ONNX w8a16 Snapdragon® X Elite 19.909 ms 33 - 33 MB NPU
proposal_generator ONNX w8a16 Snapdragon® 8 Gen 3 Mobile 13.657 ms 17 - 557 MB NPU
proposal_generator ONNX w8a16 Qualcomm® QCS6490 2949.748 ms 187 - 204 MB CPU
proposal_generator ONNX w8a16 Qualcomm® QCS8550 (Proxy) 19.337 ms 6 - 28 MB NPU
proposal_generator ONNX w8a16 Qualcomm® QCS9075 28.746 ms 16 - 19 MB NPU
proposal_generator ONNX w8a16 Snapdragon® 8 Elite For Galaxy Mobile 11.019 ms 14 - 498 MB NPU
proposal_generator ONNX w8a16 Snapdragon® 7 Gen 4 Mobile 1404.84 ms 190 - 197 MB CPU
proposal_generator ONNX w8a8 Snapdragon® 8 Elite Gen 5 Mobile 4.805 ms 8 - 427 MB NPU
proposal_generator ONNX w8a8 Snapdragon® X2 Elite 4.97 ms 19 - 19 MB NPU
proposal_generator ONNX w8a8 Snapdragon® X Elite 11.625 ms 19 - 19 MB NPU
proposal_generator ONNX w8a8 Snapdragon® 8 Gen 3 Mobile 8.547 ms 9 - 473 MB NPU
proposal_generator ONNX w8a8 Qualcomm® QCS6490 444.574 ms 151 - 178 MB CPU
proposal_generator ONNX w8a8 Qualcomm® QCS8550 (Proxy) 11.962 ms 0 - 26 MB NPU
proposal_generator ONNX w8a8 Qualcomm® QCS9075 15.718 ms 7 - 10 MB NPU
proposal_generator ONNX w8a8 Snapdragon® 8 Elite For Galaxy Mobile 6.276 ms 6 - 426 MB NPU
proposal_generator ONNX w8a8 Snapdragon® 7 Gen 4 Mobile 357.745 ms 152 - 160 MB CPU
proposal_generator QNN_DLC float Snapdragon® 8 Elite Gen 5 Mobile 22.226 ms 7 - 493 MB NPU
proposal_generator QNN_DLC float Snapdragon® X2 Elite 22.33 ms 7 - 7 MB NPU
proposal_generator QNN_DLC float Snapdragon® X Elite 54.164 ms 7 - 7 MB NPU
proposal_generator QNN_DLC float Snapdragon® 8 Gen 3 Mobile 37.347 ms 7 - 557 MB NPU
proposal_generator QNN_DLC float Qualcomm® QCS8275 (Proxy) 184.315 ms 2 - 469 MB NPU
proposal_generator QNN_DLC float Qualcomm® QCS8550 (Proxy) 53.332 ms 7 - 10 MB NPU
proposal_generator QNN_DLC float Qualcomm® SA8775P 67.435 ms 1 - 468 MB NPU
proposal_generator QNN_DLC float Qualcomm® QCS9075 78.863 ms 7 - 27 MB NPU
proposal_generator QNN_DLC float Qualcomm® QCS8450 (Proxy) 87.073 ms 7 - 502 MB NPU
proposal_generator QNN_DLC float Qualcomm® SA7255P 184.315 ms 2 - 469 MB NPU
proposal_generator QNN_DLC float Qualcomm® SA8295P 76.9 ms 0 - 433 MB NPU
proposal_generator QNN_DLC float Snapdragon® 8 Elite For Galaxy Mobile 28.107 ms 0 - 478 MB NPU
proposal_generator QNN_DLC w8a16 Snapdragon® 8 Elite Gen 5 Mobile 22.928 ms 4 - 452 MB NPU
proposal_generator QNN_DLC w8a16 Snapdragon® X2 Elite 24.603 ms 4 - 4 MB NPU
proposal_generator QNN_DLC w8a16 Snapdragon® X Elite 55.76 ms 4 - 4 MB NPU
proposal_generator QNN_DLC w8a16 Snapdragon® 8 Gen 3 Mobile 36.194 ms 4 - 756 MB NPU
proposal_generator QNN_DLC w8a16 Qualcomm® QCS6490 163.95 ms 1 - 12 MB NPU
proposal_generator QNN_DLC w8a16 Qualcomm® QCS8275 (Proxy) 97.338 ms 1 - 547 MB NPU
proposal_generator QNN_DLC w8a16 Qualcomm® QCS8550 (Proxy) 54.604 ms 4 - 367 MB NPU
proposal_generator QNN_DLC w8a16 Qualcomm® SA8775P 54.322 ms 1 - 547 MB NPU
proposal_generator QNN_DLC w8a16 Qualcomm® QCS9075 76.989 ms 0 - 11 MB NPU
proposal_generator QNN_DLC w8a16 Qualcomm® QCM6690 463.997 ms 4 - 541 MB NPU
proposal_generator QNN_DLC w8a16 Qualcomm® QCS8450 (Proxy) 61.636 ms 4 - 737 MB NPU
proposal_generator QNN_DLC w8a16 Qualcomm® SA7255P 97.338 ms 1 - 547 MB NPU
proposal_generator QNN_DLC w8a16 Qualcomm® SA8295P 65.549 ms 0 - 542 MB NPU
proposal_generator QNN_DLC w8a16 Snapdragon® 8 Elite For Galaxy Mobile 25.416 ms 4 - 444 MB NPU
proposal_generator QNN_DLC w8a16 Snapdragon® 7 Gen 4 Mobile 63.812 ms 4 - 532 MB NPU
proposal_generator QNN_DLC w8a8 Snapdragon® 8 Elite Gen 5 Mobile 20.803 ms 2 - 436 MB NPU
proposal_generator QNN_DLC w8a8 Snapdragon® X2 Elite 21.291 ms 2 - 2 MB NPU
proposal_generator QNN_DLC w8a8 Snapdragon® X Elite 41.322 ms 2 - 2 MB NPU
proposal_generator QNN_DLC w8a8 Snapdragon® 8 Gen 3 Mobile 27.277 ms 2 - 496 MB NPU
proposal_generator QNN_DLC w8a8 Qualcomm® QCS6490 64.955 ms 2 - 8 MB NPU
proposal_generator QNN_DLC w8a8 Qualcomm® QCS8275 (Proxy) 71.627 ms 2 - 439 MB NPU
proposal_generator QNN_DLC w8a8 Qualcomm® QCS8550 (Proxy) 40.263 ms 2 - 6 MB NPU
proposal_generator QNN_DLC w8a8 Qualcomm® SA8775P 40.354 ms 2 - 440 MB NPU
proposal_generator QNN_DLC w8a8 Qualcomm® QCS9075 43.701 ms 4 - 10 MB NPU
proposal_generator QNN_DLC w8a8 Qualcomm® QCM6690 196.887 ms 2 - 443 MB NPU
proposal_generator QNN_DLC w8a8 Qualcomm® QCS8450 (Proxy) 47.242 ms 2 - 491 MB NPU
proposal_generator QNN_DLC w8a8 Qualcomm® SA7255P 71.627 ms 2 - 439 MB NPU
proposal_generator QNN_DLC w8a8 Qualcomm® SA8295P 45.15 ms 2 - 439 MB NPU
proposal_generator QNN_DLC w8a8 Snapdragon® 8 Elite For Galaxy Mobile 23.73 ms 2 - 441 MB NPU
proposal_generator QNN_DLC w8a8 Snapdragon® 7 Gen 4 Mobile 28.887 ms 2 - 437 MB NPU
proposal_generator TFLITE float Snapdragon® 8 Elite Gen 5 Mobile 16.174 ms 10 - 494 MB NPU
proposal_generator TFLITE float Qualcomm® SA8295P 54.6 ms 11 - 446 MB NPU
proposal_generator TFLITE w8a8 Snapdragon® 8 Elite Gen 5 Mobile 7.02 ms 2 - 444 MB NPU
proposal_generator TFLITE w8a8 Snapdragon® 8 Gen 3 Mobile 12.505 ms 2 - 485 MB NPU
proposal_generator TFLITE w8a8 Qualcomm® QCS8275 (Proxy) 29.659 ms 3 - 427 MB NPU
proposal_generator TFLITE w8a8 Qualcomm® QCS8550 (Proxy) 16.623 ms 3 - 5 MB NPU
proposal_generator TFLITE w8a8 Qualcomm® SA8775P 16.615 ms 3 - 427 MB NPU
proposal_generator TFLITE w8a8 Qualcomm® QCS9075 20.505 ms 1 - 30 MB NPU
proposal_generator TFLITE w8a8 Qualcomm® QCS8450 (Proxy) 21.651 ms 3 - 478 MB NPU
proposal_generator TFLITE w8a8 Qualcomm® SA7255P 29.659 ms 3 - 427 MB NPU
proposal_generator TFLITE w8a8 Qualcomm® SA8295P 21.267 ms 3 - 427 MB NPU
proposal_generator TFLITE w8a8 Snapdragon® 8 Elite For Galaxy Mobile 8.849 ms 2 - 437 MB NPU
proposal_generator TFLITE w8a8 Snapdragon® 7 Gen 4 Mobile 23.656 ms 2 - 443 MB NPU
roi_head ONNX float Snapdragon® 8 Elite Gen 5 Mobile 27.727 ms 10 - 1471 MB NPU
roi_head ONNX float Snapdragon® X2 Elite 31.36 ms 32 - 32 MB NPU
roi_head ONNX float Snapdragon® X Elite 67.563 ms 29 - 29 MB NPU
roi_head ONNX float Snapdragon® 8 Gen 3 Mobile 47.86 ms 10 - 1540 MB NPU
roi_head ONNX float Qualcomm® QCS8550 (Proxy) 64.037 ms 0 - 33 MB NPU
roi_head ONNX float Qualcomm® QCS9075 115.33 ms 10 - 22 MB NPU
roi_head ONNX float Snapdragon® 8 Elite For Galaxy Mobile 44.3 ms 0 - 1374 MB NPU
roi_head ONNX w8a16 Snapdragon® 8 Elite Gen 5 Mobile 15.713 ms 0 - 473 MB NPU
roi_head ONNX w8a16 Snapdragon® X2 Elite 17.074 ms 14 - 14 MB NPU
roi_head ONNX w8a16 Snapdragon® X Elite 34.224 ms 12 - 12 MB NPU
roi_head ONNX w8a16 Snapdragon® 8 Gen 3 Mobile 24.842 ms 5 - 484 MB NPU
roi_head ONNX w8a16 Qualcomm® QCS6490 8663.527 ms 3029 - 3042 MB CPU
roi_head ONNX w8a16 Qualcomm® QCS8550 (Proxy) 33.315 ms 0 - 436 MB NPU
roi_head ONNX w8a16 Qualcomm® QCS9075 45.693 ms 5 - 8 MB NPU
roi_head ONNX w8a16 Snapdragon® 8 Elite For Galaxy Mobile 20.748 ms 0 - 461 MB NPU
roi_head ONNX w8a16 Snapdragon® 7 Gen 4 Mobile 3801.914 ms 2951 - 2958 MB CPU
roi_head ONNX w8a8 Snapdragon® 8 Elite Gen 5 Mobile 7.997 ms 0 - 310 MB NPU
roi_head ONNX w8a8 Snapdragon® X2 Elite 8.751 ms 15 - 15 MB NPU
roi_head ONNX w8a8 Snapdragon® X Elite 19.074 ms 14 - 14 MB NPU
roi_head ONNX w8a8 Snapdragon® 8 Gen 3 Mobile 13.567 ms 2 - 358 MB NPU
roi_head ONNX w8a8 Qualcomm® QCS6490 1711.233 ms 2531 - 2540 MB CPU
roi_head ONNX w8a8 Qualcomm® QCS8550 (Proxy) 18.496 ms 0 - 20 MB NPU
roi_head ONNX w8a8 Qualcomm® QCS9075 70.04 ms 2 - 5 MB NPU
roi_head ONNX w8a8 Snapdragon® 8 Elite For Galaxy Mobile 9.399 ms 0 - 311 MB NPU
roi_head ONNX w8a8 Snapdragon® 7 Gen 4 Mobile 985.728 ms 2555 - 2562 MB CPU
roi_head QNN_DLC float Snapdragon® 8 Elite Gen 5 Mobile 28.13 ms 1 - 1308 MB NPU
roi_head QNN_DLC float Snapdragon® X2 Elite 31.238 ms 10 - 10 MB NPU
roi_head QNN_DLC float Snapdragon® X Elite 63.755 ms 10 - 10 MB NPU
roi_head QNN_DLC float Snapdragon® 8 Gen 3 Mobile 48.044 ms 10 - 1516 MB NPU
roi_head QNN_DLC float Qualcomm® QCS8275 (Proxy) 332.686 ms 0 - 1315 MB NPU
roi_head QNN_DLC float Qualcomm® QCS8550 (Proxy) 64.278 ms 0 - 25 MB NPU
roi_head QNN_DLC float Qualcomm® SA8775P 96.188 ms 0 - 1315 MB NPU
roi_head QNN_DLC float Qualcomm® QCS9075 103.692 ms 12 - 23 MB NPU
roi_head QNN_DLC float Qualcomm® QCS8450 (Proxy) 116.599 ms 4 - 433 MB NPU
roi_head QNN_DLC float Qualcomm® SA7255P 332.686 ms 0 - 1315 MB NPU
roi_head QNN_DLC float Qualcomm® SA8295P 88.71 ms 0 - 386 MB NPU
roi_head QNN_DLC float Snapdragon® 8 Elite For Galaxy Mobile 40.868 ms 10 - 1234 MB NPU
roi_head QNN_DLC w8a16 Snapdragon® 8 Elite Gen 5 Mobile 13.414 ms 5 - 418 MB NPU
roi_head QNN_DLC w8a16 Snapdragon® X2 Elite 16.055 ms 5 - 5 MB NPU
roi_head QNN_DLC w8a16 Snapdragon® X Elite 31.05 ms 5 - 5 MB NPU
roi_head QNN_DLC w8a16 Snapdragon® 8 Gen 3 Mobile 24.612 ms 5 - 428 MB NPU
roi_head QNN_DLC w8a16 Qualcomm® QCS6490 147.728 ms 7 - 13 MB NPU
roi_head QNN_DLC w8a16 Qualcomm® QCS8275 (Proxy) 95.064 ms 5 - 375 MB NPU
roi_head QNN_DLC w8a16 Qualcomm® QCS8550 (Proxy) 30.857 ms 5 - 7 MB NPU
roi_head QNN_DLC w8a16 Qualcomm® SA8775P 32.375 ms 5 - 373 MB NPU
roi_head QNN_DLC w8a16 Qualcomm® QCS9075 45.125 ms 1 - 7 MB NPU
roi_head QNN_DLC w8a16 Qualcomm® QCM6690 656.52 ms 5 - 517 MB NPU
roi_head QNN_DLC w8a16 Qualcomm® QCS8450 (Proxy) 46.096 ms 5 - 427 MB NPU
roi_head QNN_DLC w8a16 Qualcomm® SA7255P 95.064 ms 5 - 375 MB NPU
roi_head QNN_DLC w8a16 Qualcomm® SA8295P 50.546 ms 0 - 371 MB NPU
roi_head QNN_DLC w8a16 Snapdragon® 8 Elite For Galaxy Mobile 19.274 ms 5 - 421 MB NPU
roi_head QNN_DLC w8a16 Snapdragon® 7 Gen 4 Mobile 55.938 ms 5 - 462 MB NPU
roi_head QNN_DLC w8a8 Snapdragon® 8 Elite Gen 5 Mobile 7.845 ms 2 - 307 MB NPU
roi_head QNN_DLC w8a8 Snapdragon® X2 Elite 9.113 ms 2 - 2 MB NPU
roi_head QNN_DLC w8a8 Snapdragon® X Elite 18.943 ms 2 - 2 MB NPU
roi_head QNN_DLC w8a8 Snapdragon® 8 Gen 3 Mobile 13.492 ms 2 - 340 MB NPU
roi_head QNN_DLC w8a8 Qualcomm® QCS6490 82.875 ms 2 - 7 MB NPU
roi_head QNN_DLC w8a8 Qualcomm® QCS8275 (Proxy) 51.504 ms 2 - 291 MB NPU
roi_head QNN_DLC w8a8 Qualcomm® QCS8550 (Proxy) 18.467 ms 2 - 5 MB NPU
roi_head QNN_DLC w8a8 Qualcomm® SA8775P 18.618 ms 1 - 291 MB NPU
roi_head QNN_DLC w8a8 Qualcomm® QCS9075 75.795 ms 0 - 4 MB NPU
roi_head QNN_DLC w8a8 Qualcomm® QCM6690 333.381 ms 2 - 376 MB NPU
roi_head QNN_DLC w8a8 Qualcomm® QCS8450 (Proxy) 38.572 ms 2 - 337 MB NPU
roi_head QNN_DLC w8a8 Qualcomm® SA7255P 51.504 ms 2 - 291 MB NPU
roi_head QNN_DLC w8a8 Qualcomm® SA8295P 28.345 ms 2 - 294 MB NPU
roi_head QNN_DLC w8a8 Snapdragon® 8 Elite For Galaxy Mobile 9.501 ms 2 - 306 MB NPU
roi_head QNN_DLC w8a8 Snapdragon® 7 Gen 4 Mobile 30.44 ms 2 - 321 MB NPU
roi_head TFLITE float Snapdragon® 8 Elite Gen 5 Mobile 1990.26 ms 0 - 2959 MB NPU
roi_head TFLITE float Qualcomm® SA8295P 517.528 ms 0 - 1601 MB CPU
roi_head TFLITE w8a8 Snapdragon® 8 Elite Gen 5 Mobile 171.788 ms 0 - 1454 MB NPU
roi_head TFLITE w8a8 Snapdragon® 8 Gen 3 Mobile 285.243 ms 0 - 1598 MB NPU
roi_head TFLITE w8a8 Qualcomm® QCS8275 (Proxy) 515.787 ms 0 - 1280 MB NPU
roi_head TFLITE w8a8 Qualcomm® QCS8550 (Proxy) 362.898 ms 0 - 4 MB NPU
roi_head TFLITE w8a8 Qualcomm® SA8775P 365.49 ms 0 - 1279 MB NPU
roi_head TFLITE w8a8 Qualcomm® QCS9075 396.042 ms 0 - 33 MB NPU
roi_head TFLITE w8a8 Qualcomm® QCS8450 (Proxy) 873.023 ms 1 - 805 MB NPU
roi_head TFLITE w8a8 Qualcomm® SA7255P 515.787 ms 0 - 1280 MB NPU
roi_head TFLITE w8a8 Qualcomm® SA8295P 385.004 ms 0 - 665 MB NPU
roi_head TFLITE w8a8 Snapdragon® 8 Elite For Galaxy Mobile 196.723 ms 0 - 1348 MB NPU
roi_head TFLITE w8a8 Snapdragon® 7 Gen 4 Mobile 1832.743 ms 1060 - 2306 MB NPU

License

  • The license for the original implementation of Detectron2-Detection can be found here.

References

Community

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support