kashif/xtoken-distillation-bucket
Updated • 25
Kashif Rasul
kashif
AI & ML interests
Time Series Forecasting, Denoising Diffusion, Generative Modeling, Reinforcement Learning
Recent Activity
reacted to sergiopaniego's post with 🤗 3 days ago
you can train DiffusionGemma (a block-diffusion LLM) in TRL! and we're sharing an example for it
TRL trainers are made to be easily extended and adapted to different real-world use cases.
in this one, with a single method overridden in SFTTrainer (compute_loss), you can train this model
> example: https://github.com/huggingface/trl/blob/main/examples/scripts/sft_diffusion_gemma.py upvoted a paper 3 days ago
Skillful joint probabilistic weather forecasting from marginalsOrganizations
