syntropy-ai/Soren-1-Small
Text Generation • 2B • Updated • 127 • 40
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
105
Active filters: preference-optimization
tokutsu/japanese-answer-13b-8bit
Updated • 12
HaiZhiYan/CheX-Phi35V
Visual Question Answering • Updated • 2
tahamajs/llama-3.2-3b-orpo-lora64-4bit-instruct
Updated • 3
Likhith003/dpo-pairrm-lora-adapter
Text Generation • 1B • Updated • 6
Likhith003/dpo-llmjudge-lora-adapter
Text Generation • 1B • Updated • 9
jasperyeoh2/mistral-dpo-peft
Updated • 2
loganlin777/mistral-7b-dpo-adapter
Updated
gandhiraketla277/finance-llama-3.1-8b-dpo-trained
Text Generation • Updated • 2
ecoxial2007/CheX-Phi4MM-GRPO
Image-Text-to-Text • 6B • Updated • 14 • 1
vidavox/Qwen3-SKK-32B-DPO
Text Generation • Updated
Nishef/MiniCPM-1B-sft-bf16-Full_KTO_20251225_185339
Text Generation • Updated
Nishef/Qwen3-0.6B-Full_DPO_20251225_130318
Text Generation • Updated
Nishef/Qwen3-0.6B-Full_ENHANCED_KTO_20251225_162818
Text Generation • Updated
Nishef/Qwen3-0.6B-Full_KTO_20251225_102050
Text Generation • Updated
Nishef/Qwen3-0.6B-Full_ORPO_20251225_145426
Text Generation • Updated
Nishef/SmolLM2-360M-Full_DPO_20251225_043457
Text Generation • Updated
Nishef/SmolLM2-360M-Full_ENHANCED_KTO_20251225_074953
Text Generation • Updated
Nishef/SmolLM2-360M-Full_KTO_20251225_020028
Text Generation • Updated
Nishef/SmolLM2-360M-Full_ORPO_20251225_062447
Text Generation • Updated
Nishef/SmolLM2-360M-Full_ENHANCED_KTO_20251225_074953-merged
Text Generation • 0.4B • Updated • 17
Nishef/Qwen3-0.6B-Full_ENHANCED_KTO_20251225_162818-merged
Text Generation • 0.6B • Updated • 23 • 1
Nishef/SmolLM2-360M-Full_KTO_20251225_020028-merged
Text Generation • 0.4B • Updated • 23
Nishef/SmolLM2-360M-Full_DPO_20251225_043457-merged
Text Generation • 0.4B • Updated • 10
Nishef/SmolLM2-360M-Full_ORPO_20251225_062447-merged
Text Generation • 0.4B • Updated • 11
Nishef/Qwen3-0.6B-Full_KTO_20251225_102050-merged
Text Generation • 0.6B • Updated • 9
Nishef/Qwen3-0.6B-Full_DPO_20251225_130318-merged
Text Generation • 0.6B • Updated • 15
Nishef/Qwen3-0.6B-Full_ORPO_20251225_145426-merged
Text Generation • 0.6B • Updated • 11
Nishef/MiniCPM-1B-sft-bf16-Full_KTO_20251225_185339-merged
Text Generation • 1B • Updated • 9
Nishef/SmolLM2-360M-Full_KNOWLEDGE_RETAINING_ENHANCED_KTO_20251227_151509
Text Generation • Updated • 5