October 13, 2025

LLM Direct Preference Optimization Using Synthetic Data: Domain Specific Model Training and Benchmarking