Quentin-Herau commited on
Commit
e4ef8a7
·
0 Parent(s):

initial commit

Browse files
Files changed (3) hide show
  1. .gitattributes +35 -0
  2. README.md +43 -0
  3. lfg_seg_motion_1.3b.pt +3 -0
.gitattributes ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,43 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ tags:
4
+ - autonomous-driving
5
+ - depth-estimation
6
+ - segmentation
7
+ - motion-prediction
8
+ - self-supervised
9
+ library_name: pytorch
10
+ ---
11
+
12
+ # LFG
13
+
14
+ LFG checkpoint that jointly predicts **dense depth / 3D points, camera pose, per-point confidence, object segmentation (7 classes), and per-pixel motion** from monocular driving video — no human labels.
15
+
16
+ LFG: Self-Supervised 4D Learning from In-the-Wild Driving Videos — trained on 58M+ unlabeled dashcam driving frames with frozen teachers generating pseudo ground truth on the fly. See the [project page](https://lfg-ai.github.io/) and the [inference repo](https://github.com/Applied-Intuition-Open-Source/LFG).
17
+
18
+ ## Model details
19
+
20
+ | | |
21
+ |---|---|
22
+ | Architecture | LFG (autoregressive transformer with future-frame prediction) |
23
+ | Parameters | 1.22B (fp32) |
24
+ | Input | monocular video, 3 history frames |
25
+ | Encoder | DINOv2 |
26
+ | Heads | point/depth, camera/pose, confidence, segmentation (7 classes), motion |
27
+
28
+ ## Files
29
+
30
+ - `lfg_seg_motion_1.3b.pt` — minimal inference checkpoint: `model_state_dict` (inference weights only), `config` (architecture settings), `global_step`. Loads with `torch.load(..., weights_only=True)`.
31
+
32
+ ## Usage
33
+
34
+ Use the [official inference repo](https://github.com/Applied-Intuition-Open-Source/LFG):
35
+
36
+ ```bash
37
+ python infer.py <video-or-image-dir> \
38
+ --checkpoint lfg_seg_motion_1.3b.pt \
39
+ --output-dir outputs/ \
40
+ --save-visualizations
41
+ ```
42
+
43
+ Outputs per window: `points`, `local_points`, `camera_poses`, `conf`, `segmentation`, `motion`.
lfg_seg_motion_1.3b.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bf5ff54d143512b9ccbad8ae474e988c4333bbca3b9d2bc02f21f42255a9416e
3
+ size 4874393866