idekoh commited on
Commit
71f70d4
·
verified ·
1 Parent(s): c8c6233

Unify model card for both checkpoints

Browse files
Files changed (1) hide show
  1. README.md +49 -10
README.md CHANGED
@@ -1,5 +1,5 @@
1
  ---
2
- license: apache-2.0
3
  language:
4
  - en
5
  tags:
@@ -8,17 +8,16 @@ tags:
8
  - multimodal
9
  - multi-object
10
  - pointllm
 
11
  pipeline_tag: text-generation
12
  ---
13
 
14
- # Multi-3DLLM
15
 
16
- Multi-3DLLM is the released checkpoint for BeyondSingleObject: Learning 3D
17
- Relations with Large Language Models. It extends the PointLLM-style 3D LLM
18
- interface to multiple point-cloud inputs and is intended for MO3D, Shape
19
- Mating, and Change Captioning experiments.
20
 
21
- ## Usage
 
22
 
23
  Use the code and scripts from:
24
 
@@ -26,15 +25,46 @@ Use the code and scripts from:
26
  https://github.com/KohsukeIde/BeyondSingleObject
27
  ```
28
 
 
 
 
 
 
 
 
29
  Expected local layout:
30
 
31
  ```text
32
- checkpoints/multi-3dllm/
 
 
33
  data/
34
  ```
35
 
36
- Example inference commands are provided in `scripts/eval/infer.sh`, and
37
- LLM-based evaluation wrappers are provided in `scripts/eval/eval_llm.sh`.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
38
 
39
  ## Notes
40
 
@@ -43,6 +73,15 @@ judge model and prompt configuration. Use the released evaluation scripts for
43
  reproducible comparisons, and report the exact judge configuration together
44
  with the checkpoint.
45
 
 
 
 
 
 
 
 
 
 
46
  ## Citation
47
 
48
  ```bibtex
 
1
  ---
2
+ license: other
3
  language:
4
  - en
5
  tags:
 
8
  - multimodal
9
  - multi-object
10
  - pointllm
11
+ - modelnet40
12
  pipeline_tag: text-generation
13
  ---
14
 
15
+ # Multi-3DLLM Checkpoints
16
 
17
+ This repository hosts the released BeyondSingleObject checkpoints:
 
 
 
18
 
19
+ - `multi-3dllm/`: MO3D, Shape Mating, and Change Captioning
20
+ - `multi-3dllm-classification/`: ModelNet40 zero-shot classification
21
 
22
  Use the code and scripts from:
23
 
 
25
  https://github.com/KohsukeIde/BeyondSingleObject
26
  ```
27
 
28
+ ## Download
29
+
30
+ ```bash
31
+ huggingface-cli download idekoh/Multi-3DLLM multi-3dllm --local-dir checkpoints/multi-3dllm
32
+ huggingface-cli download idekoh/Multi-3DLLM multi-3dllm-classification --local-dir checkpoints/multi-3dllm-classification
33
+ ```
34
+
35
  Expected local layout:
36
 
37
  ```text
38
+ checkpoints/
39
+ ├── multi-3dllm/
40
+ └── multi-3dllm-classification/
41
  data/
42
  ```
43
 
44
+ ## Usage
45
+
46
+ Example inference and LLM-based evaluation:
47
+
48
+ ```bash
49
+ MODEL_PATH=checkpoints/multi-3dllm \
50
+ OUTPUT_DIR=outputs/infer \
51
+ scripts/eval/infer.sh
52
+ ```
53
+
54
+ ModelNet40 classification:
55
+
56
+ ```bash
57
+ MODEL_PATH=checkpoints/multi-3dllm-classification \
58
+ OUTPUT_DIR=outputs/modelnet40_eval \
59
+ LIMIT=0 \
60
+ PROMPT_MODE=paper \
61
+ NUM_OBJECTS=1 \
62
+ TARGET_POSITION=1 \
63
+ scripts/eval/eval_modelnet.sh
64
+ ```
65
+
66
+ Repeat `(NUM_OBJECTS, TARGET_POSITION) = (1,1), (2,1), (2,2), (3,1), (3,2),
67
+ (3,3)` for the full table.
68
 
69
  ## Notes
70
 
 
73
  reproducible comparisons, and report the exact judge configuration together
74
  with the checkpoint.
75
 
76
+ ## License
77
+
78
+ These checkpoints are built with the BeyondSingleObject codebase and use
79
+ PointLLM-style initialization and data. They may inherit terms from upstream
80
+ model, code, and dataset components, including PointLLM, Vicuna/Llama,
81
+ Objaverse/Cap3D, ShapeTalk, Thingi10K, Neural Shape Mating, and ModelNet40.
82
+ Please check the corresponding upstream licenses before redistribution or
83
+ commercial use.
84
+
85
  ## Citation
86
 
87
  ```bibtex