Attention Sinks Are Provably Necessary in Softmax Transformers: Evidence from Trigger-Conditional Tasks
Paper
• 2603.11487 • Published
• 1
Yuval Ran-Milo
YuvMil
·
AI & ML interests
None yet
Recent Activity
submitted
a paper
about 20 hours ago
Attention Sinks Are Provably Necessary in Softmax Transformers: Evidence from Trigger-Conditional Tasks authored
a paper
about 1 month ago
Outcome-Based RL Provably Leads Transformers to Reason, but Only With the Right Data Organizations
None yet
submitted a paper to Daily Papers about 20 hours ago
authored a paper about 1 month ago