BasicsBuilds on other terms
Context window
Written by Minh Khang
What is Context window?
A context window is how much text an AI can see in one go: the prompt, the documents and the conversation so far.
Whatever falls outside the window, the AI cannot see. In a very long conversation the beginning may be cut or get less attention, so important instructions belong in the base prompt rather than said once and forgotten.
Context window in a shop
The chatbot forgot the returns policy you gave it at the start: the instruction may have slid out of the context window.
Keep learning beyond the glossary
Read next
- BasicsTokenA token is a small piece of text that AI reads and writes, such as a word, part of a word or a punctuation mark. AI prices and limits are counted in tokens.
- Data and accuracyRAGRAG (retrieval-augmented generation) is letting AI find and read your documents before it answers, instead of answering from memory.