Haleshot/Mathmate-7B-DELLA-ORPO
7B • Updated • 7
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
182
Active filters: preference-learning
ilgee/Binary-Think-RM-8B
8B • Updated • 9
ilgee/Multiclass-Think-RM-8B
8B • Updated • 12
codelion/gemma-3-1b-it-reasoning-grpo-lora
Text Generation • Updated • 4 • 4
ilgee/Binary-Think-RM-3B
3B • Updated • 5 • 1
codelion/Qwen2.5-Coder-0.5B-Instruct-security-grpo-lora
Text Generation • Updated • 13
pyamy/llama3-dpo-pairrm
Updated • 4
pyamy/llama3-dpo-llm-judge
Updated • 3
5456es/selective_dpo_Llama-3.2-1B-Instruct_prune_0.7-sigmoid
1B • Updated • 3
5456es/selective_dpo_Qwen2.5-1.5B-Instruct_prune_0.7-sigmoid
2B • Updated • 15
5456es/cluster_prune_Qwen2.5-1.5B-Instruct_prune_0.7-sigmoid
2B • Updated • 12
5456es/cluster_prune_Llama-3.2-1B-Instruct_prune_0.7-sigmoid
1B • Updated • 6
5456es/implicit_reward_Qwen2.5-1.5B-Instruct_prune_0.7-sigmoid
2B • Updated • 5
5456es/cluster_prune_Llama-3.2-1B-Instruct_prune_0.3-sigmoid
1B • Updated • 13
5456es/implicit_reward_Llama-3.2-1B-Instruct_prune_0.3-sigmoid
1B • Updated • 24
5456es/implicit_reward_Qwen2.5-0.5B-Instruct_prune_0.7-sigmoid
0.5B • Updated • 7
5456es/cluster_prune_Qwen2.5-1.5B-Instruct_prune_0.3-sigmoid
2B • Updated • 6
5456es/cluster_prune_Qwen2.5-0.5B-Instruct_prune_0.3-sigmoid
0.5B • Updated • 4
5456es/selective_dpo_Qwen2.5-0.5B-Instruct_prune_0.7-sigmoid
0.5B • Updated • 16
5456es/selective_dpo_Qwen2.5-1.5B-Instruct_prune_0.3-sigmoid
2B • Updated • 3
5456es/cluster_prune_Qwen2.5-0.5B-Instruct_prune_0.7-sigmoid
0.5B • Updated • 19
5456es/selective_dpo_Llama-3.2-1B-Instruct_prune_0.3-sigmoid
1B • Updated • 4
5456es/implicit_reward_Qwen2.5-1.5B-Instruct_prune_0.3-sigmoid
2B • Updated • 5
5456es/cluster_prune_Qwen2.5-0.5B-Instruct_prune_0.5-sigmoid
0.5B • Updated • 4
5456es/selective_dpo_Qwen2.5-0.5B-Instruct_prune_0.3-sigmoid
0.5B • Updated • 4
5456es/selective_dpo_Llama-3.2-1B-Instruct_prune_0.5-sigmoid
1B • Updated • 11
5456es/selective_dpo_Qwen2.5-0.5B-Instruct_prune_0.5-sigmoid
0.5B • Updated • 23
5456es/implicit_reward_Llama-3.2-1B-Instruct_prune_0.5-sigmoid
1B • Updated • 5
5456es/selective_dpo_Qwen2.5-1.5B-Instruct_prune_0.5-sigmoid
2B • Updated • 7
5456es/cluster_prune_Qwen2.5-1.5B-Instruct_prune_0.5-sigmoid
2B • Updated • 5