🧠 Token Embeddings in LLMs They’re also often called vector embeddings or word embeddings. 🔤 From Tokens to Token Embeddings (Step 3) Before a model can “read” anything, it first breaks text into smaller chunks called tokens. Each token is then assigned a unique token ID, a simple integer from the vocabulary. For …