Update README.md
Browse files
README.md
CHANGED
|
@@ -28,8 +28,8 @@ different modalities:
|
|
| 28 |
|
| 29 |
| Path | Model | Modalities | Role in the notebook |
|
| 30 |
|---|---|---|---|
|
| 31 |
-
| `conditioning_and_guidance/joint_model` | Unconditional cross-modal MLP | `coordinates` (continuous, 2D) and `index` (discrete, 4 categories) | Intrinsic guidance (Section
|
| 32 |
-
| `conditioning_and_guidance/context_model` | The same MLP plus a label context path, trained with
|
| 33 |
|
| 34 |
### Loading
|
| 35 |
|
|
@@ -51,16 +51,3 @@ checkpointer = Checkpointer(
|
|
| 51 |
)
|
| 52 |
gen_model = nnx.merge(graphdef, checkpointer.restore_ema(params))
|
| 53 |
```
|
| 54 |
-
|
| 55 |
-
`restore_ema` reads only `ema_params` and `extra`, and applies the same bias
|
| 56 |
-
correction the training loop uses for evaluation.
|
| 57 |
-
|
| 58 |
-
## Reproducing
|
| 59 |
-
|
| 60 |
-
```bash
|
| 61 |
-
uv run python tutorials/scripts/train_conditioning_checkpoints.py
|
| 62 |
-
```
|
| 63 |
-
|
| 64 |
-
The script mirrors the notebook's model definitions and PRNG chain, so it
|
| 65 |
-
reproduces these exact weights. A checkpoint pins the parameter structure: if a
|
| 66 |
-
notebook's network changes, re-run the script and re-upload.
|
|
|
|
| 28 |
|
| 29 |
| Path | Model | Modalities | Role in the notebook |
|
| 30 |
|---|---|---|---|
|
| 31 |
+
| `conditioning_and_guidance/joint_model` | Unconditional cross-modal MLP | `coordinates` (continuous, 2D) and `index` (discrete, 4 categories) | Intrinsic guidance (Section 3): conditioning a model that was never trained to be conditional |
|
| 32 |
+
| `conditioning_and_guidance/context_model` | The same MLP plus a label context path, trained with 50% context dropout | `coordinates` only; the corner label is passed as `context_data` instead of as a modality | Context conditioning and classifier-free guidance (Sections 4) |
|
| 33 |
|
| 34 |
### Loading
|
| 35 |
|
|
|
|
| 51 |
)
|
| 52 |
gen_model = nnx.merge(graphdef, checkpointer.restore_ema(params))
|
| 53 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|