Transformers How to use hf-internal-testing/tiny-random-chatglm3-6b with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("hf-internal-testing/tiny-random-chatglm3-6b", trust_remote_code=True, dtype="auto") 
