Long chats and compaction
Models don’t remember your chat between messages — Knecty sends the conversation so far with every message. Two things follow:
- Long chats cost more per message, because there’s more to read each time.
- A chat can grow too long for a model to read at all.
Compaction fixes both. A model writes a summary of the conversation so far, and from then on models read the summary plus the latest messages instead of the whole history.
Nothing disappears
Your older messages stay on screen. A card marks the point: “Compacted {n} messages with {model}”, with how many tokens it saves per message. Tap View summary to read it.
The summary covers the goal, decisions made, facts and figures, open questions, your preferences, and where things stand, in the language you mostly used.
When compaction happens
- When you choose it — Compact in the message box toolbar (on smaller screens, ⋯ → Compact this chat). You see the cost first and confirm.
- When Knecty suggests it — once a chat fills about 80% of what the model can read, a note offers Compact with what you’d save per message. Dismiss it with ✕ if you’d rather not.
- Automatically — if your next message wouldn’t fit, Knecty compacts first and then sends. The card explains what happened.
- When you switch to a model that can’t hold the chat — Knecty offers Compact & switch, or Cancel to stay on your current model.
- When a reply fails because the chat is too long — tap Compact now on the reply.
What it costs
The summary is written by the model that wrote the latest reply (or a model from the same company that can hold the chat), at that model’s rates plus the platform fee. The confirm screen shows the estimate. It shows as “Chat compaction” in your wallet. If you stop it or it fails, you aren’t charged.
Edit or undo
- Edit the summary to fix or add something — free. Models read your edited version, marked “Summary edited”.
- Undo compaction on the newest card makes models read the full conversation again. The summary’s cost isn’t refunded.
- Editing or regenerating a message above a compaction removes that compaction first (you’re asked to confirm).
Good to know
- Attached files aren’t part of the summary; they’re still read with each message. Pause the ones you don’t need — see Files that stay in a chat.
- Compaction isn’t available in incognito chats or in Compare.
- Shared links and exports include the compaction card and its summary.