INCModel
/

NextStep-1.1-W4A16-AutoRound

4-bit precision

Model card Files Files and versions

xinhe commited on Apr 10

Commit

9ea4a22

·

verified ·

1 Parent(s): 9ce1d43

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -16,7 +16,7 @@ hf download INCModel/NextStep-1.1-W4A16-AutoRound  /workspace/models/stepfun-ai/
 export PYTHONPATH=/workspace/models/stepfun-ai/NextStep-1.1-W4A16/
 cd /workspace/models/stepfun-ai/NextStep-1.1-W4A16/
 uv pip install transformers==4.57.6
-uv pip install gptqmodel==6.0.3 --no-build-isolation
 python run_generation.py
 ~~~

 export PYTHONPATH=/workspace/models/stepfun-ai/NextStep-1.1-W4A16/
 cd /workspace/models/stepfun-ai/NextStep-1.1-W4A16/
 uv pip install transformers==4.57.6
+uv pip install gptqmodel==5.8.0 --no-build-isolation
 python run_generation.py
 ~~~