Perplexity from Scratch: How a Model Predicts the Next Token

Use a worked next-token example to understand perplexity and its role and limits in prompt compression.