What the Dev?

Optimizing infrastructure for LLMs - Episode 235

October 31, 2023
What the Dev?
Optimizing infrastructure for LLMs - Episode 235
Show Notes

In this episode, we explore the infrastructure that is needed for LLMs, the key components to building it, and common challenges. We also talk about why LLMs hallucinate and how to reduce the frequency of that from occurring. 

Joining us in the discussion this week is Trey Doig, CTO and co-founder of Pathlight, which is a generative AI company.