Little to no output
#2
by webslug - opened
Hi I tried codellama-7b.ggmlv3.Q2_K.bin in the text generation web ui but I get little to no output on Instruct mode. Chat mode barely works. I've increased the threads.
Not sure why it's not working but the model seems incapable of generating code.
This is the base model so it's not been fine tuned I believe, so it won't necessarily be great at answering questions. Try one the -Instruct or -Python model with the prompt template which I just added to their READMEs:
[INST] Write code to solve the following coding problem that obeys the constraints and
passes the example test cases. Please wrap your code answer using ```:
{PROMPT}
[/INST]
Thank you very much, I will try that.