Upload _claude_memory/feedback_hf_before_delete.md with huggingface_hub
Browse files
_claude_memory/feedback_hf_before_delete.md
ADDED
|
@@ -0,0 +1,17 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
name: HF before delete
|
| 3 |
+
description: Always upload valuable data (ckpts, logs, predictions) to Hugging Face BEFORE deleting from local disk. Don't lose data to disk pressure.
|
| 4 |
+
type: feedback
|
| 5 |
+
originSessionId: 4037f43b-2133-46c6-84bd-02f7d454ec8b
|
| 6 |
+
---
|
| 7 |
+
**Rule**: Before running `rm` / `git rm` / quarantine-delete on any artifact under `/workspace/dnathinker/` or `/shm/dnathinker_quarantine/`, **first upload to HF if it isn't already mirrored**.
|
| 8 |
+
|
| 9 |
+
**Why**: User direction (2026-05-05) after I deleted Phase-8 RL through-MDLM `log.jsonl` files from `/shm/dnathinker_quarantine/` during cycle 50 cleanup. Those logs were the ONLY source for the `F6_rl_training_curves.pdf` paper figure. They were not on HF; deletion was irreversible. Result: F6 panel can't be regenerated and we lost reproducibility.
|
| 10 |
+
|
| 11 |
+
**How to apply**:
|
| 12 |
+
1. Before any `rm` on `/workspace/dnathinker/runs/` or `/shm/dnathinker_quarantine/`, check `MANIFEST.tsv` for an `HF: <repo>/<path>` annotation.
|
| 13 |
+
2. If absent, run `scripts/innovations/hf_auto_uploader.py --once` (or specifically `hf_upload_finished_models.py` for ckpts) and verify upload succeeded BEFORE deleting.
|
| 14 |
+
3. For run-dir cleanup: keep `log.jsonl`, `manifest.json`, `train.log`, `eval_*.log`, and any `*_score*.json/md` — they're tiny and used to regenerate paper figures. ckpts can be deleted if HF-mirrored.
|
| 15 |
+
4. Annotate the deletion in `/shm/dnathinker_quarantine/MANIFEST.tsv` with the HF reference.
|
| 16 |
+
|
| 17 |
+
**Exceptions**: tmp files (`/tmp/*`, `_bench_logs` rotations explicitly marked stale, intermediate dataloader caches that are fast to regenerate) don't need HF round-trip.
|