Every request starts with the same block: system instructions, examples, sometimes a whole document. The model re-reads all of it from scratch, every single time.
Prompt caching keeps that shared prefix. Same answer, less waiting, smaller bill — the repeated part can cost a fraction of normal price.
Order matters: what never changes goes first, the user's question last.
Cache the part that never changes. Pay for it once.