Lab 01: From Language to Matrix — Prompts, Tokens and Generation Parameters
Interactive inspection of BPE subwords with tiktoken, multilingual cost asymmetry, ChatML delimiters, and stochastic temperature variability.
Key Lab Topics
- Tokenización BPE
- ChatML Framing
- Temperatura Estocástica
- Asimetría Lingüística
Prerequisites
- Python 3.10+
- tiktoken
Resources & Architecture Guide
This hands-on lab runs in a Jupyter Notebook (lab-01-prompts-y-tokens.ipynb) and includes a comprehensive architectural guide: