How much GPU memory is required for BF16?
How much GPU memory is required for BF16?
I'm running about 29.6 gb with a 5 second, .4megapixel gen, which is eating up about 100 gb of shared gpu memory (ram).
what is the minimun vram + ram config
I will be testing all the models soon on my rtx pro 6000.
Will see how much each of them takes
I'm able to run the 55gb text encoder and the 66.3gb model file together on my 128gb system ram and 24gb 4090.
I'm able to run the 55gb text encoder and the 66.3gb model file together on my 128gb system ram and 24gb 4090.
I am curious about generation speeds, I downloading the prunned Convrot files hoping to get good speeds. also what res are you pushing?
Well, speed is not the goal when juggling these beasts. lol. It is waaaaaaaaaaaaaay faster running the quantized versions. 4s 720p vid: 1st run was 15:01 then subsequent were 416-422s. The load times are brutal.
Well, speed is not the goal when juggling these beasts. lol. It is waaaaaaaaaaaaaay faster running the quantized versions. 4s 720p vid: 1st run was 15:01 then subsequent were 416-422s. The load times are brutal.
did you anyone checked the quality difference between the bf16, int8 and int8_pruned? any speed and quality comparison?
The quality is very close between the 3 versions. In fact, you can run the small one to see what kind of output you will get, and if you love the video, then re-run it with the same random number seed, with the high quality version of the model. You can think of it as a way to get a master copy, with the quantized versions offering very close almost identical previews. I posted a side by side comparison on my X acct, but I don't think I can post that link here.