Episode Notes: https://thedataexchange.media/lastmil...
Sarmad Qadri, founder and CEO of LastMile, a startup building an AI developer platform for engineering teams.
*Sections*
LastMile AI the origin story 00:01:21
GenAI signature of an application 00:08:14
An Overview and a Demo of aiconfig a Flexible Tooling for ProductionReady AI 00:09:36
aiconfig and emerging design patterns (mixture of experts and beyond) 00:15:47
Retrieval augmented generation (RAG) 00:19:17
Evaluating RAG setups 00:22:37
Staffing GenAI projects 00:23:55
Open source LLMs and existing endpoints like Anyscale 00:26:09
Status of their RAG tool (semantic retrieval) 00:31:20
Orchestration 00:34:55
ETL tools for GenAI applications 00:37:08
Risk mitigation 00:40:01