University of Pennsylvania

university

Verified

https://www.upenn.edu

Activity Feed Request to join this org

AI & ML interests

None defined yet.

Recent Activity

timlautk submitted a paper about 19 hours ago

Symmetry-Compatible Principle for Optimizer Design: Embeddings, LM Heads, SwiGLU MLPs, and MoE Routers

AjayP13 authored a paper 4 months ago

FineInstructions: Scaling Synthetic Instructions to Pre-Training Scale

CCB authored a paper about 1 year ago

Concept Lancet: Image Editing with Compositional Representation Transplant

View all activity

Papers

Symmetry-Compatible Principle for Optimizer Design: Embeddings, LM Heads, SwiGLU MLPs, and MoE Routers

View all Papers

upenn 's Papers 1

Submitted by

Tim Tsz-Kit Lau

Symmetry-Compatible Principle for Optimizer Design: Embeddings, LM Heads, SwiGLU MLPs, and MoE Routers

upenn

University of Pennsylvania