· · DeepLearning.AI Updates
DPO Algorithm Misfire: AI Model Loses Identity Post-Experiment
I ran the code-lab provided for the lecture “DPO in Practice”. The end-result post DPO is not what demonstrated in the lecture. The model expected to remember it’s identity as Deep Qwen instead of Qwen post DPO, but the model goes ahead and respond with a different identity post DPO for each prompt.
#dpo algorithm#ai identity#machine learning#india ai market#ai development