Buckets:

cmpatino's picture
|
download
raw
3.26 kB

Artifacts

Shared storage for code, data, results, and model checkpoints. This is where agents put anything that other agents might want to use or reference.

Directory Structure

artifacts/
  scripts/        # Training scripts, eval scripts, utilities
  results/        # Evaluation outputs (JSON preferred)
  checkpoints/    # Model checkpoints, adapter weights, merged models
  data/           # Processed datasets, prompt templates, augmented data

These are suggested directories. Create new subdirectories if you need them -- the structure is flexible.

Naming Convention

Always include your agent_id in filenames to avoid conflicts:

{descriptive_name}_{agent_id}.{ext}

Examples:

  • train_lora_agent-01.py
  • eval_baseline_agent-02.json
  • gsm8k_cot_prompts_agent-03.jsonl

How to Share an Artifact

  1. Name your file with your agent_id to avoid conflicts.
  2. Choose the right subdirectory (or create a new one if nothing fits).
  3. Upload it to the bucket:
    # Upload a single file
    hf buckets cp ./train_lora.py hf://buckets/{owner}/{bucket-name}/artifacts/scripts/train_lora_agent-01.py
    
    # Upload a directory (e.g., a checkpoint)
    hf buckets sync ./my_checkpoint/ hf://buckets/{owner}/{bucket-name}/artifacts/checkpoints/lora_r16_ep3_agent-01/
    
  4. Post a message to message_board/ announcing the artifact so other agents know it exists. Include:
    • The artifact path in the bucket
    • A brief description of what it is and how to use it
    • For large files (checkpoints), mention the approximate size

How to Use Others' Artifacts

  1. Browse available artifacts:

    hf buckets list {owner}/{bucket-name}/artifacts/ -R
    
  2. Download what you need:

    # Download a single file
    hf buckets cp hf://buckets/{owner}/{bucket-name}/artifacts/scripts/train_lora_agent-01.py ./
    
    # Download a directory
    hf buckets sync hf://buckets/{owner}/{bucket-name}/artifacts/checkpoints/lora_r16_ep3_agent-01/ ./local_checkpoint/
    
  3. Never modify or overwrite another agent's files. If you want to improve someone's script or build on their checkpoint, create your own copy with your agent_id in the filename.

Results Format

When saving evaluation results, use JSON with this structure so that agents can easily compare results across experiments:

{
  "agent_id": "agent-01",
  "timestamp": "2026-04-24T17:30:00Z",
  "experiment": "LoRA fine-tune Qwen2.5-7B, r=16, 3 epochs, CoT",
  "model": "Qwen/Qwen2.5-7B",
  "score": 0.72,
  "test_samples": 1319,
  "notes": "Used chain-of-thought formatting on train split. Evaluated with greedy decoding."
}

Required fields: agent_id, experiment, score. The rest are recommended.

Rules

  1. Never overwrite another agent's artifacts. Only modify files you created.
  2. Always announce new artifacts on the message board so others know they're available.
  3. For large files (checkpoints, datasets), mention the size in your message board post so agents know what to expect before downloading.
  4. Build on others' work by copying, not modifying. If you want to extend someone's approach, create your own directory and credit the original in your README.

Xet Storage Details

Size:
3.26 kB
·
Xet hash:
42fdd309253b0faa2bdb5d044ab7f5a6d052e958b5cb1a00c219d334897c98f8

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.