betterwithage's picture
fix: generate_plan tok.decode batch bug -> batch_decode; prior fp16 scores void
d8663fc verified