Rapidata/svg-benchmark
Viewer • Updated • 318k • 1.41k • 34
Alex Caldarone
caldarons
AI & ML interests
None yet
Recent Activity
reacted to jasoncorkill's post with 🚀 3 days ago
Most public benchmarks collapse model performance into one broad preference signal.
That makes it hard to understand which capabilities differentiate between models. It's also almost impossible to inspect the evidence behind it. So @RapidataAI is releasing Benchmark.AI.
We started with an SVG generation benchmark including 42 models, 500 prompts, 1.9M+ human judgements, 300K+ match-ups.
We evaluate models separately on Preference, Alignment and Coherence, while making the prompts, outputs, match-ups and methodology public.
Full dataset: https://huggingface.co/datasets/Rapidata/svg-benchmark
Full benchmark: https://www.benchmark.ai/svg
Methodology feedback and benchmark suggestions very welcome!
liked a dataset 2 months ago
Rapidata/svg-benchmark liked a dataset 8 months ago
Rapidata/bananamark-datasetOrganizations
liked a
dataset 2 months ago
liked a
dataset 8 months ago
liked 3
datasets 9 months ago
liked 4
datasets 10 months ago
Rapidata/text-2-video-human-preferences-veo3.1
Viewer • Updated • 1.64k • 146 • 9
Rapidata/Face_Generation_Benchmark
Viewer • Updated • 2.31k • 53 • 16
Rapidata/text-2-video-human-preferences-sora-2
Viewer • Updated • 1.39k • 61 • 10
Rapidata/text-2-video-human-preferences-sora-2-pro
Viewer • Updated • 1.49k • 72 • 9