Massive Activations in Hybrid Linear Attention Large Language Models: Pre-Attention Spikes and Inter-Spike Plateaus
Paper • 2608.12149 • Published • 19
Lil2J
Lil2J
AI & ML interests
LLM
Recent Activity
liked a model 4 months ago
Jackrong/Qwopus3.6-27B-v1-preview updated a model 4 months ago
LMIS-ORG/ToolOrchestra_Slime_Agentic_Qwen3_8BOrganizations
upvoted a paper 1 day ago
liked a
model 4 months ago
updated a
model 4 months ago
published a
model 4 months ago
liked a
model 4 months ago
updated a
model 4 months ago
published a
model 5 months ago
updated 2
models 5 months ago
liked a
model 5 months ago
Upload model-00000-of-00003.safetensors with huggingface_hub
#5 opened 5 months ago
by 
Lil2J
Upload merges.txt with huggingface_hub
#4 opened 5 months ago
by Lil2J
Upload configuration.json with huggingface_hub
#2 opened 5 months ago
by Lil2J
Upload generation_config.json with huggingface_hub
#3 opened 5 months ago
by Lil2J
Upload config.json with huggingface_hub
#1 opened 5 months ago
by Lil2J
published a
model 5 months ago
updated a
Space 5 months ago
published a
Space 5 months ago
liked a
model 5 months ago
updated a
model 6 months ago