NM Testing

company

AI & ML interests

None defined yet.

Recent Activity

nm-autobot updated a model 2 minutes ago

nm-testing/multiple_modifiers_gptq_awq-e2e

nm-autobot updated a model 10 minutes ago

nm-testing/kv_cache_gptq_tinyllama-e2e

nm-autobot updated a model 14 minutes ago

nm-testing/kv_cache_fp8-e2e

View all activity

nm-testing 's models 559

nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A16-G128-uncompressed

1B • Updated Jan 14, 2025 • 228

nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A16-G128-compressed

1B • Updated Jan 14, 2025 • 686

nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16-G128-uncompressed

1B • Updated Jan 14, 2025 • 217

nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16-G128-compressed

1B • Updated Jan 14, 2025 • 813

nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8-Dynamic-uncompressed

1B • Updated Jan 14, 2025 • 224

nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8-Dynamic-compressed

1B • Updated Jan 14, 2025 • 1.1k

nm-testing/granite-3.1-3b-a800m-instruct-w4a16

3B • Updated Jan 9, 2025 • 3

nm-testing/DeepSeek-V2.5-1210-quantized.w4a16

238B • Updated Jan 7, 2025 • 4

nm-testing/llama-2-7b-sparse2of4

7B • Updated Jan 4, 2025 • 1

nm-testing/test-w4a16-mixtral-actorder-group

47B • Updated Dec 26, 2024 • 1.4k

nm-testing/llama2.c-stories15M-gsm8k-pruned.2of4-BitMask

22.2M • Updated Dec 19, 2024 • 6

nm-testing/llama2.c-stories15M-gsm8k-pruned.2of4-Uncompressed

24.4M • Updated Dec 19, 2024 • 4

nm-testing/gemma-2-9b-it-FP8-dynamic-KV

10B • Updated Dec 18, 2024 • 3

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-tensor_wts_tensor_act_int8-BitM

5B • Updated Dec 17, 2024 • 7

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-tensor_wts_tensor_act_fp8-BitM

5B • Updated Dec 17, 2024 • 4

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-tensor_wts_per_tok_dyn_act_int8-BitM

5B • Updated Dec 17, 2024 • 7

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-tensor_wts_per_tok_dyn_act_fp8-BitM

5B • Updated Dec 17, 2024 • 6

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-chnl_wts_tensor_act_int8-BitM

5B • Updated Dec 17, 2024 • 6

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-chnl_wts_tensor_act_fp8-BitM

5B • Updated Dec 17, 2024 • 2

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-tensor_wts_tensor_act_int8-BitM

0.7B • Updated Dec 17, 2024 • 64

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-chnl_wts_per_tok_dyn_act_int8-BitM

5B • Updated Dec 17, 2024 • 5

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-tensor_wts_tensor_act_fp8-BitM

0.7B • Updated Dec 17, 2024 • 55

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-tensor_wts_per_tok_dyn_act_int8-BitM

0.7B • Updated Dec 17, 2024 • 58

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-chnl_wts_per_tok_dyn_act_fp8-BitM

5B • Updated Dec 17, 2024 • 3

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-tensor_wts_per_tok_dyn_act_fp8-BitM

0.7B • Updated Dec 17, 2024 • 31

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-chnl_wts_tensor_act_int8-BitM

0.7B • Updated Dec 17, 2024 • 44

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-chnl_wts_tensor_act_fp8-BitM

0.7B • Updated Dec 17, 2024 • 48

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-chnl_wts_per_tok_dyn_act_fp8-BitM

0.7B • Updated Dec 17, 2024 • 37

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-chnl_wts_per_tok_dyn_act_int8-BitM

0.7B • Updated Dec 17, 2024 • 67

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-Uncompressed

1B • Updated Dec 17, 2024 • 3