Predict human preference to LLM responses.
Binfeng Xu
billxbf
AI & ML interests
evolving back to apes
Recent Activity
upvoted a paper 23 days ago
PhyCritic: Multimodal Critic Models for Physical AI upvoted a paper about 1 month ago
Golden Goose: A Simple Trick to Synthesize Unlimited RLVR Tasks from Unverifiable Internet Text updated
a dataset 2 months ago
billxbf/math_pile_v3 Organizations
models 16
billxbf/zephyr-7b-dpo-iter1
Text Generation • 274k • Updated
• 7
billxbf/zephyr-7b-dpo-iter3
Text Generation • 266k • Updated
billxbf/zephyr-7b-dpo-iter2
Text Generation • 266k • Updated
• 1
billxbf/Nano-Raccoon-Preview-1104
425k • Updated
billxbf/zephyr-7b-sft-iter3
Text Generation • 266k • Updated
• 1
billxbf/zephyr-7b-sft-iter2
Text Generation • 266k • Updated
• 1
billxbf/zephyr-7b-sft-iter1
Text Generation • 266k • Updated
• 2
billxbf/nemo-sft-orpo
12B • Updated
• 1
billxbf/chai-nemo13b-sft-orpo-merge_v2
Text Generation • 12B • Updated
billxbf/chai-nemo-sft-orpo-merge
Text Generation • 12B • Updated
• 1
datasets 20
billxbf/math_pile_v3
Viewer
• Updated
• 1.52M • 11
billxbf/ultrafeedback-dpo-iter3
Viewer
• Updated
• 20.4k • 9
billxbf/ultrafeedback-dpo-iter1
Viewer
• Updated
• 20.4k • 9
billxbf/ultrafeedback-dpo-iter2
Viewer
• Updated
• 20.4k • 8
billxbf/ultrafeedback-sft-iter3
Viewer
• Updated
• 20.4k • 9
billxbf/ultrafeedback-sft-iter2
Viewer
• Updated
• 20.4k • 10
billxbf/ultrafeedback-sft-iter1
Viewer
• Updated
• 20.4k • 10
billxbf/verified100-chitchat
Viewer
• Updated
• 100 • 8
billxbf/verified100-lite
Viewer
• Updated
• 100 • 10
billxbf/verified100
Viewer
• Updated
• 100 • 9