Read this: The context size in modern LLMs (that is, the maximum number of tokens they can process at once) is steadily increasing. Initially, moving from two or four thousand tokens to eight thousand seemed like a big achievement. Then came models with up to 32k tokens, but they were limited in availability for a … Continue reading Does context matter? →