This is my recreation of BluemoonRP on LLaMA 2 with native 4k context
DO NOT USE CHECKPOINT 60, that model is overfited
-