DPO (Klein 9B): v1.0: k9b_dpo_v1.safetensors

More, but better

This is trained on a set of DPO pairs in order to try and push Klein 9B away from the waxy skin and arm/leg/hand issues that it can suffer from. No special prompts, just try from weight 0.5 - 1.0, you can try negative weights as well and see what happens.

v0.1 - Test version

As a courtesy, if you'd like to merge it into one of your models, please ask first.