any plan about GLM-4.7-REAP-139B-FP8?

#3
by Slach - opened

thanks for your efforts, any plan about GLM-4.7-REAP-139B-FP8?

@Slach we've just uploaded some 4.7 REAPs:

25% FP8: https://hf.co/cerebras/GLM-4.7-REAP-268B-A32B-FP8
25% BF16: TBD

40% FP8: https://hf.co/cerebras/GLM-4.7-REAP-218B-A32B-FP8
40% BF16: https://hf.co/cerebras/GLM-4.7-REAP-218B-A32B

We'll look into uploading a 139B one if it doesn't degrade on benchmarks too much.

Minimax M2.1 when? Thx for your work!

@lazarevich , thanks. Unfortunately, 218B-FP8 is too large VRAM for my setup.

Sign up or log in to comment