The Lifecycle of LLM-as-a-Judge: Building, Aligning, and Monitoring at scale
- Netflix: 20 events in the last 90 days
What happened
By Emma Yanyang Kong , JJ Tan , Ishan Gupta , Lars Olds , Claire Campbell , David Fagnan , Ratna Kavuri , Rohan Gosain , Veli Balin , Minsu Jang , Louis Garcia Introduction Any team generating text with an LLM at scale hits the same problem. You cannot evaluate everything manually. You don't know which outputs are great, which are mediocre, and which are harmful, because you simply cannot read them all. The standard…
Summary assembled by rule from the sources below