Pretrained models from the paper "Predicting the Order of Upcoming Tokens Improves Language Modeling"
Zayd Muhammad Kawakibi Zuhri PRO
zaydzuhri
AI & ML interests
I really like watching loss go down
Recent Activity
upvoted a paper about 23 hours ago
Every Coin Has Two Sides: On the Dual Nature of Generalization in On-Policy Distillation of Large Language Models updated a dataset 18 days ago
zaydzuhri/permutation-composition updated a model 27 days ago
zaydzuhri/tasklets_tokenizerOrganizations
None yet
models 127
zaydzuhri/tasklets_tokenizer
Updated
zaydzuhri/tasklets_tokenizer_256
Updated
zaydzuhri/tasklets_tokenizer_512
Updated
zaydzuhri/tasklets_tokenizer_1024
Updated
zaydzuhri/tasklets_tokenizer_32
Updated
zaydzuhri/tasklets_tokenizer_64
Updated
zaydzuhri/tasklets_tokenizer_8192
Updated
zaydzuhri/tasklets_tokenizer_16
Updated
zaydzuhri/tasklets_tokenizer_75
Updated
zaydzuhri/tasklets_tokenizer_100
Updated
datasets 74
zaydzuhri/permutation-composition
Viewer • Updated • 103k • 94
zaydzuhri/modular-addition
Viewer • Updated • 103k • 121
zaydzuhri/single-stack-ops-hidden
Viewer • Updated • 103k • 30
zaydzuhri/noisy-recall
Viewer • Updated • 103k • 15
zaydzuhri/flip-flop
Viewer • Updated • 103k • 17
zaydzuhri/single-stack-ops
Viewer • Updated • 103k • 18
zaydzuhri/sorting
Viewer • Updated • 103k • 20
zaydzuhri/memorization
Viewer • Updated • 103k • 25
zaydzuhri/selective-copy
Viewer • Updated • 103k • 17
zaydzuhri/reverse-copy
Viewer • Updated • 103k • 12