DPO (Klein 9B): v0.1: dpo_k9b.safetensors

This is trained on a set of DPO pairs in order to try and push Klein 9B away from the waxy skin and arm/leg/hand issues that it can suffer from. No special prompts, just try from weight 0.5 - 1.0, you can try negative weights as well and see what happens.

v0.1 - Test version

As a courtesy, if you'd like to merge it into one of your models, please ask first.