This is What Limits Current LLMs
Recent advances in large language models (LLMs) have centered around more data, larger models, and larger context lengths. The ability of LLMs to learn in-context (i.e. in-context learning) makes longer context lengths extremely valuable. However, there are some problems with relying on just in-context learning to learn during inference.
Social Media
YouTube - / edanmeyer
Twitter - / ejmejm1