Recent advances in large language models (LLMs) have centered around more data, larger models, and larger context lengths. The ability of LLMs to learn incontext (i.e. incontext learning) makes longer context lengths extremely valuable. However, there are some problems with relying on just incontext learning to learn during inference.

Social Media
YouTube    / edanmeyer  
Twitter   / ejmejm1