My LLM Recipe Generator with AI Observability

I build a recipe generator app with LLMs. This app can help me a lot in the kitchen and has been amazing for meal planning, but how do I make sure my LLM is returning reasonable recipes? And if I have a lot of users, how do I automatically detect common issues like hallucinations? In this talk, I’ll show you my app in action and demonstrate the observability strategy I set up to detect issues live. Monitoring LLMs is hard because the output is nondeterministic. I’ll show how I used Comet Opik to implement tracing and custom eval metrics that you can use for your own projects as well.