Inference Optimization

community

AI & ML interests

None defined yet.

Recent Activity

ChibuUkachi updated a model about 11 hours ago

inference-optimization/ctest-Qwen3-8B-speculator.dflash

ChibuUkachi published a model about 11 hours ago

inference-optimization/ctest-Qwen3-8B-speculator.dflash

ChibuUkachi updated a model about 13 hours ago

inference-optimization/MiniMax-M2.5-NVFP4

View all activity

inference-optimization 's models 323

inference-optimization/gpt-oss-20b-from-gpt-oss-120b-ckpt2-speculator.eagle3

0.9B • Updated Mar 19 • 6

inference-optimization/Qwen3-Next-80B-A3B-Instruct-MTP-ultrachat-epoch3

2B • Updated Mar 19 • 8

inference-optimization/Qwen3-Next-80B-A3B-Instruct-MTP-ultrachat-epoch2

2B • Updated Mar 19 • 4

inference-optimization/Qwen3-Next-80B-A3B-Instruct-MTP-ultrachat-epoch1

2B • Updated Mar 19 • 1

inference-optimization/gpt-oss-20b-from-gpt-oss-120b-ckpt1-speculator.eagle3

0.9B • Updated Mar 19 • 6

inference-optimization/gpt-oss-20b-from-gpt-oss-120b-ckpt0-speculator.eagle3

0.9B • Updated Mar 18 • 5

inference-optimization/Llama-3.1-8B-Instruct-NVFP4-DDP8

5B • Updated Mar 18 • 4

inference-optimization/Qwen3-235B-A22B-Thinking-2507.w8a8

235B • Updated Mar 18 • 5

inference-optimization/Qwen3-235B-A22B-Instruct-2507.w8a8

235B • Updated Mar 18 • 3

inference-optimization/Qwen3-Next-80B-A3B-Instruct_mtp_speculator

Text Generation • 2B • Updated Mar 18 • 27

inference-optimization/Mistral3_speculator_dummy

2B • Updated Mar 17 • 2

inference-optimization/Phi-4-reasoning-vision-15B-FP8-dynamic

15B • Updated Mar 17 • 5

inference-optimization/Qwen3-235B-A22B-Thinking-2507.w4a16

32B • Updated Mar 17 • 5

inference-optimization/Qwen3-235B-A22B-Instruct-2507.w4a16

32B • Updated Mar 17 • 4

inference-optimization/Qwen3-32B-from-Qwen3-235B_resps-speculators.eagle3-ckpt0

2B • Updated Mar 17 • 5

inference-optimization/gpt-oss-120b-from-qwen235b-ckpt5-speculator.eagle3

0.9B • Updated Mar 16 • 5

inference-optimization/gpt-oss-120b-from-qwen235b-ckpt4-speculator.eagle3

0.9B • Updated Mar 15 • 4

inference-optimization/gpt-oss-120b-ckpt4-speculator.eagle3

0.9B • Updated Mar 12 • 2

inference-optimization/gpt-oss-120b-ckpt3-speculator.eagle3

0.9B • Updated Mar 12 • 3

inference-optimization/Qwen3-Coder-Next.w4a16

Text Generation • 12B • Updated Mar 12 • 186 • 1

inference-optimization/Llama-3.2-3B-Instruct_7_bits_mode_heuristic

3B • Updated Mar 12 • 8

inference-optimization/Llama-3.2-3B-Instruct_7_bits_mode_noise

3B • Updated Mar 12 • 7

inference-optimization/Llama-3.2-3B-Instruct_7_bits_mode_hybrid

3B • Updated Mar 12 • 9

inference-optimization/Llama-3.2-3B-Instruct_6.5_bits_mode_heuristic

3B • Updated Mar 12 • 7

inference-optimization/Llama-3.2-3B-Instruct_6.5_bits_mode_noise

3B • Updated Mar 12 • 8

inference-optimization/Llama-3.2-3B-Instruct_6.5_bits_mode_hybrid

3B • Updated Mar 12 • 8

inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_heuristic

3B • Updated Mar 12 • 8

inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_noise

3B • Updated Mar 12 • 9

inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_hybrid

3B • Updated Mar 12 • 8

inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_heuristic

3B • Updated Mar 12 • 9