Motif-Technologies
/

optimizer

Model card Files Files and versions

optimizer / test

105 kB

Ctrl+K

Ctrl+K

15 contributors

History: 24 commits

dongseokmotif's picture

feat: extend QK-Clip to support MLA (MuonClip Algorithm 1) [skip-build] (#28)

e8e2c81 unverified about 2 hours ago

README.md
1.3 kB
Support param group with various placements (#13) 5 months ago
__init__.py
0 Bytes
Support param group with various placements (#13) 5 months ago
conftest.py
5.58 kB
Add torch.compile, CUDA graph, and compiled momentum [skip-build] 23 days ago
optimizer
23 Bytes
Support param group with various placements (#13) 5 months ago
pytest.ini
45 Bytes
Support param group with various placements (#13) 5 months ago
run_test.sh
74 Bytes
Support param group with various placements (#13) 5 months ago
run_test_moe.sh
124 Bytes
Refactor pipeline to async generator pattern (#16) 28 days ago
test_cpu_memory_peak.py
18 kB
Replace cpu_offload constructor param with turn_on/turn_off API (#26) 5 days ago
test_cpu_offload.py
32.9 kB
feat: extend QK-Clip to support MLA (MuonClip Algorithm 1) [skip-build] (#28) about 2 hours ago
test_muon.py
17.1 kB
Replace toy PP tests with real-model-based pipeline tests [skip-build] 13 days ago
test_muon_moe.py
17 kB
Replace toy PP tests with real-model-based pipeline tests [skip-build] 13 days ago
test_normalize_fqn.py
3.9 kB
Update tests for MoE and parallel optimizations [skip-build] 23 days ago
utils.py
9.36 kB
Update tests for MoE and parallel optimizations [skip-build] 23 days ago