Results for SAM 3D on living organisms (blind human votes, with reference photos)
I run Taxon3D, a blind pairwise arena where people compare two anonymised 3D models of a named
organism, with CC-licensed photos of the real thing beside them. SAM 3D is on the image-to-3D
board with a Bradley-Terry score of 941, 95% interval 872 to 991, over 126 head-to-head games,
which is the most games of any model in the set. Its record against every opponent is here:
https://taxon3d.org/models/fal:sam-3d?c=hf-sam3d
Every task ships the input photo, so you can see exactly what the model was given. The set is
plants, fungi and animals, which are harder than props: thin surfaces, branching, self-occlusion.
That last part is where the interesting failures are, and they are visible per task rather than
averaged away.
If a newer checkpoint appears I will run it on the same tasks. Code is MIT and the votes are
published on Hugging Face.
Happy to answer questions about the protocol.