OzTianlu/A_Reasoning_Critique_of_Diffusion_Models
Viewer
• Updated
• 6 • 43 • 1
Zixi "Oz" Li PRO
OzTianlu
AI & ML interests
My research focuses on deep reasoning with small language models, Transformer architecture innovation, and knowledge distillation for efficient alignment and transfer.
Recent Activity
reacted
to
their post with 🤗 32 minutes ago
We deleted the Embedding Layer -- INTRO Our Collins-Embedding-3M
https://huggingface.co/NoesisLab/Collins-Embedding-3M
Most "small" models are just giant vocab tables in a trench coat. Collins-3M changes that. By using 2-Universal Hashing and Chernoff-bound noise suppression, we’ve collapsed the embedding space into a fixed O(1) hash-map.
* STSB: 0.7114 (Beating many 100M+ models)
* Size: 3M (Edge-ready, IoT-ready)
* Tech: Randomized Sign-Hashing + RoPE positional injection.
Built by NoesisLab posted an
update
about 1 hour ago
We deleted the Embedding Layer -- INTRO Our Collins-Embedding-3M
https://huggingface.co/NoesisLab/Collins-Embedding-3M
Most "small" models are just giant vocab tables in a trench coat. Collins-3M changes that. By using 2-Universal Hashing and Chernoff-bound noise suppression, we’ve collapsed the embedding space into a fixed O(1) hash-map.
* STSB: 0.7114 (Beating many 100M+ models)
* Size: 3M (Edge-ready, IoT-ready)
* Tech: Randomized Sign-Hashing + RoPE positional injection.
Built by NoesisLab updated
a model about 1 hour ago
NoesisLab/Collins-Embedding-3M Organizations
