Who am I?
A (brief) introduction to me - Romir! What I've done, am doing, and hope to do!
READ FIELD NOTE ↗> cat /notes
FIELD
NOTES
Thoughts on building and evaluating capable AI systems.
BLOG INDEX · 02 ENTRIES
LATEST
NOTE.
What DPO actually optimizes
Direct Preference Optimization turns a pair of preferred and rejected responses into a simple, useful training signal—without training a separate reward model.
READ FIELD NOTE ↗