Skip to content
APAnanya P.1mo ago

What are LLMs and how do they actually work, explained simply?

I use ChatGPT daily but couldn't explain what's happening under the hood to save my life. What's the honest simple version — not the 'it's magic' one and not the PhD one?
91
2 answers2.8K views

2 Answers

Accepted answer

ASAnanya Sharma9.8K XP1mo ago
The honest middle version: An LLM is a next-word predictor trained at absurd scale. It read most of the internet and learned, statistically, which token (word fragment) tends to follow a given sequence. When it 'answers' you, it's repeatedly asking 'given everything so far, what's the most plausible next token?' — thousands of times per response. The non-obvious part: to predict the next word REALLY well across all of human text, the model was forced to internally learn grammar, facts, reasoning patterns, coding conventions — because you can't predict the next token of a physics explanation without compressing some physics. That's why 'fancy autocomplete' undersells it. Chat behavior comes from a second phase: fine-tuning on human-rated conversations so it prefers helpful, instruction-following continuations. And hallucinations make sense in this frame — it always produces a PLAUSIBLE next token, and plausible isn't the same as true.
73
ADArjun Dev12.4K XP1mo ago
The mental model that made it click for me: it's not retrieving answers from a database, it's reconstructing them from compressed patterns — closer to how you 'remember' a book you read years ago than to looking it up. Which is exactly why it's brilliant at style and structure and unreliable on precise facts, dates and citations.
5

Know the answer?

Join Nobink to answer, vote and build your reputation.