Article
Efficient LLM Pretraining: Packed Sequences and Masked Attention
•
68
Lucas Chen
leocnj
AI & ML interests
NLP, speech, multimodal, deep learning
Recent Activity
upvoted an article 13 days ago
Efficient LLM Pretraining: Packed Sequences and Masked Attention liked
a model 17 days ago
google/functiongemma-270m-it upvoted an article 4 months ago
You could have designed state of the art positional encoding Organizations
None yet
upvoted an article 13 days ago
liked a model 17 days ago
upvoted an article 4 months ago
Article
You could have designed state of the art positional encoding
•
454
liked 2 Spaces 5 months ago
liked a model 6 months ago
liked 5 datasets 7 months ago
NousResearch/XLAM-Atropos
Viewer
• Updated
• 60k • 18 • 6
alibaba-pai/DistilQwen_100k
Viewer
• Updated
• 100k • 71 • 5
HuggingFaceH4/ifeval-like-data
Viewer
• Updated
• 5.61k • 106 • 4
BAAI/TACO
Updated
• 1.84k • 132
lmsys/lmsys-chat-1m
Viewer
• Updated
• 1M • 7.8k • 852
liked a Space 8 months ago
liked 5 datasets 8 months ago
interstellarninja/hermes_reasoning_tool_use
Viewer
• Updated
• 51k • 475 • 158
nvidia/Llama-Nemotron-Post-Training-Dataset
Viewer
• Updated
• 3.91M • 2.88k • 644
MathAndMagic/function-calling
Viewer
• Updated
• 86.9k • 914 • 9
BluebrainAI/Function_calling_SFT
Viewer
• Updated
• 348k • 25 • 3
quotientai/limbic-eval-tool-use-mcp
Viewer
• Updated
• 9.81k • 106 • 13
liked a model 8 months ago
upvoted an article 8 months ago
Article
SmolLM3: smol, multilingual, long-context reasoner
- +21
•
764
liked a dataset 9 months ago