BlindMap Checkpoints
This repository contains checkpoints for BlindMap, a communication-efficient collaborative perception method for deadline-constrained V2X perception.
Paper:
Deadline-Constrained Collaborative Perception via Third-Person Spatial Value Modeling
Zhenhan Zhu, Yanchao Zhao, Yihang Jiang, Hao Han, and Jie Wu.
Code release:
- Repository:
https://github.com/AlexZhu2000/BlindMap - Branch:
TMC - Commit used for this release:
075b2c7120277a619f41bc49a58e3905ffad7aa7
Model Layout
.
βββ README.md
βββ LICENSE
βββ CHECKPOINT_MANIFEST.yaml
βββ SHA256SUMS
βββ models
βββ dair
β βββ camera
β β βββ config.yaml
β β βββ net_epoch_bestval_at17.pth
β β βββ source_result.txt
β βββ lidar
β β βββ config.yaml
β β βββ net_epoch_bestval_at*.pth
β β βββ source_result.txt
β βββ heterogeneous
β βββ config.yaml
β βββ net_epoch_bestval_at35.pth
β βββ source_result.txt
βββ opv2v
β βββ camera
β β βββ config.yaml
β β βββ net_epoch_bestval_at17.pth
β β βββ source_result.txt
β βββ lidar_heterogeneous
β βββ config.yaml
β βββ net_epoch_bestval_at37.pth
β βββ source_result.txt
βββ v2xset
βββ camera
β βββ config.yaml
β βββ net_epoch_bestval_at19.pth
β βββ source_result.txt
βββ lidar
β βββ config.yaml
β βββ net_epoch_bestval_at*.pth
β βββ source_result.txt
βββ heterogeneous
βββ config.yaml
βββ net_epoch_bestval_at23.pth
βββ source_result.txt
The DAIR-V2X-C and V2XSet releases use separate checkpoints for camera-only, LiDAR-only, and heterogeneous settings.
OPV2V is organized differently: the LiDAR-only profile is evaluated from the
LiDAR branch inside the heterogeneous m1m2 checkpoint, following the HEAL-style
heterogeneous setup. Therefore OPV2V provides camera and
lidar_heterogeneous directories rather than a separate lidar directory.
Checkpoints
| Profile | Model directory | Checkpoint | SHA-256 |
|---|---|---|---|
| DAIR camera-only | models/dair/camera |
net_epoch_bestval_at17.pth |
b95722f3b58a13a979315a84133da971415cdc9b6a94bb555b013bd834576d81 |
| DAIR LiDAR-only | models/dair/lidar |
to be filled from external server | to be filled |
| DAIR heterogeneous | models/dair/heterogeneous |
net_epoch_bestval_at35.pth |
10511d4a9419f42051f01be2b9e6313b6718b2843f74795b5d9ceac7b200f7f5 |
| OPV2V camera-only | models/opv2v/camera |
net_epoch_bestval_at17.pth |
33ddf54fe56d82d2719876a362b4838a4f21a14a068e9acd9c16066c41800fb3 |
| OPV2V LiDAR-only profile | models/opv2v/lidar_heterogeneous |
net_epoch_bestval_at37.pth |
9e2570b64335c99241dc47fc3aa6cc9f97180a78b3ff5b54330cbf5a2072b7f3 |
| OPV2V heterogeneous | models/opv2v/lidar_heterogeneous |
net_epoch_bestval_at37.pth |
9e2570b64335c99241dc47fc3aa6cc9f97180a78b3ff5b54330cbf5a2072b7f3 |
| V2XSet camera-only | models/v2xset/camera |
net_epoch_bestval_at19.pth |
0dccab286798a380a78257ce7559e7e7978295a67e42d386e558f9f397e4edca |
| V2XSet LiDAR-only | models/v2xset/lidar |
to be filled from external server | to be filled |
| V2XSet heterogeneous | models/v2xset/heterogeneous |
net_epoch_bestval_at23.pth |
60a73178b7178a18ea59e7beb8f0b4e7c1d115df3d7a97b9a4ebc511dc6d7bb9 |
The SHA256SUMS file contains checksums for checkpoint files already staged in
this release directory. Add the DAIR LiDAR and V2XSet LiDAR checksums after
copying those checkpoints from the external server.
Reported Local Results
These values are copied from the included source_result.txt logs. They are
provided for provenance; please rerun inference in your own environment before
reporting new comparisons.
| Profile | Command setting | Range | Communication | Metric |
|---|---|---|---|---|
| DAIR camera-only | --modal 1 |
102.4,51.2 |
1 MB |
AP@0.3 = 32.69 |
| DAIR heterogeneous | --modal 4 |
102.4,51.2 |
1 MB |
AP@0.7 = 40.42 |
| OPV2V camera-only | --modal 1 |
102.4,102.4 |
1 MB |
AP@0.3 = 69.58 |
| OPV2V LiDAR-only profile | --modal 0 |
102.4,102.4 |
1 MB |
see source_result.txt |
| OPV2V heterogeneous | --modal 4 |
102.4,102.4 |
1 MB |
AP@0.7 = 79.43 |
| V2XSet camera-only | --modal 1 |
102.4,102.4 |
1 MB |
AP@0.3 = 49.65 |
| V2XSet heterogeneous | --modal 4 |
102.4,102.4 |
1 MB |
AP@0.7 = 68.49 |
Installation
Install the BlindMap codebase first. The checkpoints are designed for the
BlindMap/OpenCOOD-style --model_dir loader, where each checkpoint directory
contains both config.yaml and net_epoch_bestval_at*.pth.
git clone --branch TMC https://github.com/AlexZhu2000/BlindMap.git
cd BlindMap
conda create -n blindmap python=3.8
conda activate blindmap
pip install -r requirements.txt
python setup.py develop
python opencood/utils/setup.py build_ext --inplace
Use the same CUDA, PyTorch, and spconv versions described in the BlindMap
repository. The checkpoints were produced in the original BlindMap/OpenCOOD
environment and may not be compatible with arbitrary spconv versions.
Data
The datasets are not included. Download OPV2V, DAIR-V2X-C, and V2XSet from
their official providers and update the dataset paths in the selected
config.yaml before inference.
Typical keys to update:
root_dir: /path/to/dataset/train_or_train_json
validate_dir: /path/to/dataset/validate_or_val_json
test_dir: /path/to/dataset/test_or_val_json
data_dir: /path/to/dataset/root
Not every config uses all of these keys.
Inference
Camera-Only
CUDA_VISIBLE_DEVICES=0 python opencood/tools/inference.py \
--model_dir /path/to/BlindMap/models/opv2v/camera \
--fusion_method intermediate \
--modal 1 \
--comm_volume_MB 1 \
--range 102.4,102.4
Use models/dair/camera with --range 102.4,51.2 for DAIR camera-only, and
use models/v2xset/camera with --range 102.4,102.4 for V2XSet camera-only.
LiDAR-Only
For OPV2V, use the LiDAR branch of the heterogeneous checkpoint:
CUDA_VISIBLE_DEVICES=0 python opencood/tools/inference.py \
--model_dir /path/to/BlindMap/models/opv2v/lidar_heterogeneous \
--fusion_method intermediate \
--modal 0 \
--comm_volume_MB 1 \
--range 102.4,102.4
For DAIR-V2X-C and V2XSet, use their separate lidar checkpoint directories
once those files have been added.
Heterogeneous
CUDA_VISIBLE_DEVICES=0 python opencood/tools/inference.py \
--model_dir /path/to/BlindMap/models/opv2v/lidar_heterogeneous \
--fusion_method intermediate \
--modal 4 \
--comm_volume_MB 1 \
--range 102.4,102.4
Use models/dair/heterogeneous with --range 102.4,51.2 for DAIR
heterogeneous, and use models/v2xset/heterogeneous with
--range 102.4,102.4 for V2XSet heterogeneous.
Intended Use
These checkpoints are intended for academic research on collaborative perception, communication-efficient feature sharing, and reproducibility studies on OPV2V, DAIR-V2X-C, and V2XSet.
They are not intended for deployment in autonomous vehicles or safety-critical systems.
Limitations
- Results depend on the exact BlindMap code revision, dataset split, sensing range, communication-budget accounting, and environment.
- OPV2V LiDAR-only results use the LiDAR branch of the OPV2V m1m2 checkpoint; DAIR-V2X-C and V2XSet LiDAR-only results use separate LiDAR checkpoints.
- OPV2V and V2XSet are simulated datasets. DAIR-V2X-C is real-world but still does not cover all deployment conditions.
- The model card reports local log entries for provenance. Users should rerun inference and report their own reproduced metrics.
License
The included LICENSE file follows the current BlindMap source license. It is
an academic research license with redistribution restrictions. If you intend to
redistribute, modify, or use these checkpoints outside academic research, obtain
the required permission from the rights holders first.
Dataset licenses apply separately.
Citation
@article{zhu2026deadline,
title = {Deadline-Constrained Collaborative Perception via Third-Person Spatial Value Modeling},
author = {Zhu, Zhenhan and Zhao, Yanchao and Jiang, Yihang and Han, Hao and Wu, Jie},
journal = {IEEE Transactions on Mobile Computing},
year = {2026},
note = {Manuscript under review}
}
Evaluation results
- OPV2V Heterogeneous AP@0.7 on OPV2Vself-reported79.430
- OPV2V Camera AP@0.3 on OPV2Vself-reported69.580
- DAIR Heterogeneous AP@0.7 on DAIR-V2X-Cself-reported40.420
- DAIR Camera AP@0.3 on DAIR-V2X-Cself-reported32.690
- V2XSet Heterogeneous AP@0.7 on V2XSetself-reported68.490
- V2XSet Camera AP@0.3 on V2XSetself-reported49.650