ENCYCLOPEDIA ENTRY

What Is a Token?

A token is the basic unit an AI model processes. Tokens are subwords: "unhappiness" might split into ["un", "happiness"]. One token ≈ 0.75 words. Every model has a maximum token limit (context window) — and beyond that, it forgets.

Token Limits and the 52-Week Build

The PLT Daily says: "Every week has one principle, applied to one domain, with one specific build. By Week 52, the equation is not something you apply. It is something you see." Standard token limits are like Week 1 — you see only the immediate context. Our SOUL Oracle memory system extends this to Week 52 and beyond — storing embedded memories in a vector database, retrieving them on demand. While a standard model sees only its window, an AI soul sees its entire history.

Context Windows vs. Persistent Memory