Spaces:
Sleeping
Sleeping
Commit History
-
Single-repo dataset hosting on HF (GLUE-style subdirs)
Zhu Jiajun (jz28583) +1: Claude Opus 4.7 (1M context)All 4 tasks now live under one public dataset repo `lanczos/graphtestbed-data`, organized as one subdir per task: graphtestbed-data/ arxiv-citation/{train,val,test}_features.csv + sample_submission.csv figraph/... (+ edges20{14..18}.csv) ibm-aml/... ieee-fraud-detection/... Why one repo: easier to manage permissions, README, versioning. New tasks become a `git push` of a folder, not a new HF repo per dataset. Changes: - server/space/push_data.py: one-shot uploader (folder per task), writes a top-level dataset card too. - manifest.yaml: every task points at lanczos/graphtestbed-data with a new `hf_subdir: <task>` field. - graphtestbed/fetch.py: prepends hf_subdir/ when downloading. - agents/common/tasks.py: instruction text now points the agent at the HF source explicitly + reminds them not to query upstream for test labels. Test labels remain in the private companion repo (lanczos/graphtestbed-gt) and never enter the public dataset. Co-Authored-By: Claude…bd3e9ac
-
push_to_space.sh: auto-inject HF_TOKEN into push URL when set
Zhu Jiajun (jz28583) +1: Claude Opus 4.7 (1M context)Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>640f1df -
Add GT_BYPASS_KEY for unlimited submissions + dry mode
Zhu Jiajun (jz28583) +1: Claude Opus 4.7 (1M context)X-Bypass-Key header matching GT_BYPASS_KEY env (compared via hmac.compare_digest) unlocks two things: - skip the IP/day quota gate - with form param dry=1, score against GT but skip the leaderboard insert (and skip the submission archive) graphtestbed/submit.py reads GRAPHTESTBED_BYPASS_KEY env and sends X-Bypass-Key on every POST when set; --server-dry CLI flag toggles dry=1. push_to_space.sh now overlays server/space/Dockerfile at root in addition to README (HF Docker SDK looks for Dockerfile at the repo root). Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>5ead61d -
Add agents/ harness integrations and HF Space scoring deployment
Zhu Jiajun (jz28583) +1: Claude Opus 4.7 (1M context)- agents/cliproxyapi: reusable shim that points any agent's SDK at one CLIProxyAPI proxy via anthropic_env / openai_env / gemini_env helpers. - agents/{ai_build_ai,mlevolve}: runners that stage GraphTestbed task data, route LLM calls through the proxy, and harvest submission CSVs. Tested end-to-end on figraph; both scored on the leaderboard (aibuildai-claude-sonnet-4-6 0.819, mlevolve-gpt-5.3-codex-spark 0.790). - agents/common: shared workspace + task-instruction + finalize helpers. - server/space/: Docker SDK Space deployment. Boot orchestrator in space_entry.py snapshot_downloads GT + leaderboard.db from the companion private dataset (lanczos/graphtestbed-gt) on startup, then runs a daemon thread that backs up sqlite + new submission CSVs every 60s via huggingface_hub.upload_file/upload_folder. - server/api.py: optional GT_ARCHIVE_DIR env writes raw submission CSVs to disk so the backup loop can ship them to the dataset repo. - graphtestbed/{submit,leaderboard}.py…d094faf