• Measuring LLMs with Jodie Burchell

  • Apr 3 2025
  • Length: 1 hr and 1 min
  • Podcast

Measuring LLMs with Jodie Burchell

Listen for free

View show details

  • Summary

  • How do you measure the quality of a large language model? Carl and Richard talk to Dr. Jodie Burchell about her work measuring large language models for accuracy, reliability, and consistency. Jodie talks about the variety of benchmarks that exist for LLMs and the problems they have. A broader conversation about quality digs into the idea that LLMs should be targeted to the particular topic area they are being used for - often, smaller is better! Building a good test suite for your LLM is challenging but can increase your confidence that the tool will work as expected.
    Show More Show Less
Show More Show Less

What listeners say about Measuring LLMs with Jodie Burchell

Average customer ratings

Reviews - Please select the tabs below to change the source of reviews.

Audible.co.uk reviews

Amazon reviews
No Reviews are Available