Fix cancel generation to gracefully stop ongoing response generation a73d8f4 luigi-liu-tw commited on Oct 12, 2025
Fix dynamic_shapes kwargs to match inputs structure for AOT compilation 273acf8 luigi-liu-tw commited on Oct 12, 2025
Fix AOT compilation dynamic_shapes to match expected arg names for torch.export.export 0a99dfc luigi-liu-tw commited on Oct 12, 2025
Improve model size detection: replace ad-hoc string parsing with reliable params_b field in MODELS dict ab92e0d luigi-liu-tw commited on Oct 12, 2025
Set better defaults for free-tier users: Qwen3-1.7B model, 1024 max tokens, search disabled 2cae073 luigi-liu-tw commited on Oct 12, 2025
Adjust duration estimation for H200 performance - reduce conservative estimates de766da luigi-liu-tw commited on Oct 12, 2025
Use actual parameter count for AOT decision instead of string matching e3e334f luigi-liu-tw commited on Oct 12, 2025
Make AOT compilation conditional for models >= 2B parameters to optimize free tier usage 4500f92 luigi-liu-tw commited on Oct 12, 2025
Add AOT compilation optimization for ZeroGPU acceleration a7866ff luigi-liu-tw commited on Oct 12, 2025
add 4 20b+ models after enabling dynamic gpu duration fea2910 verified Luigi commited on Oct 12, 2025
Add dynamic duration calculation for ZeroGPU acceleration 6073cc2 luigi-liu-tw commited on Oct 12, 2025
disable two models that cannot run or too run too slowly on hf spaces with zerogpu 3dc7ced luigi-liu-tw commited on Oct 11, 2025
feat(models): add Granite-4.0-Micro and Qwen3-4B-Instruct-2507 to MODELS registry c30a7f7 verified Luigi commited on Oct 9, 2025