Studio Matrx Monthly · Volume 1 · Issue 4 · September 2026
Amogh N P
 In loving memory of Amogh N P — Architect · Designer · Visionary 
How Claude ThinksLesson 0.2
Claude for Architects & Designers/Module 0 · Meet Claude

Lesson 0.2 · Meet Claude

How Claude Thinks

An LLM predicts the most plausible next word, over and over, from what is in its context window - understand that and you know why Claude is brilliant, why it hallucinates, and how to prompt it.

12 min Interactive lessonFree · open lessonByAmogh N P· Architect & interior designer
The hook

To prompt Claude well and catch it when it is wrong, you have to know the one thing it is actually doing under the hood.

In Lesson 0.1 you met Claude as a brilliant intern you direct and judge. This lesson opens the bonnet. You do not need the mathematics of neural networks to use Claude well, any more than you need combustion theory to drive - but you do need an accurate picture of the one operation it performs, because that picture explains both why Claude is so useful and exactly how it fails. Every good habit in this course - giving context, asking for sources, checking the numbers, scaling your scrutiny to the stakes - falls straight out of understanding the machine.

Here is the whole thing in a sentence: Claude reads everything in front of it and predicts, one word at a time, the most plausible continuation. That is it. Out of that single trick comes summarising, reasoning, drafting, translating and coding - and out of the same trick come confident, fluent, wrong answers that nothing in the machine flags. Understand the trick and you stop being surprised by either. You will prompt more deliberately, trust more selectively, and know, task by task, how hard to check.

Next word, endlessly. Plausible != true. Fill the window with real facts. Check where wrong is expensive.

One trick, endlessly repeated

An LLM is trained on an enormous amount of text, and from all of it, it learns one skill with uncanny depth: given a run of words, predict the word most likely to come next. Ask it to continue 'The minimum clear width of a corridor should be...' and it weighs every plausible continuation it has ever seen - '1.2 m', '1200 mm', 'wide enough', and, far down the list, nonsense like 'aubergine' - and picks from the front of that ranked field. Then it appends that word and does the whole thing again, and again, until the answer is complete. There is no separate step where it looks up a fact, consults a rulebook, or checks whether what it is about to say is true. There is only the next word, and the next.

This sounds far too simple to produce what you actually experience - and yet it is the engine under every summary, rationale and script Claude writes. The reason it works is that producing genuinely plausible text at this scale requires a working grasp of grammar, facts, tone, structure and even reasoning patterns, because those are what make one continuation more likely than another. To reliably predict the next word in a fire-code paragraph, a model has to have absorbed how fire-code paragraphs go. So the prediction machine behaves, most of the time, like something that understands.

But hold onto what it is optimising for: plausibility, not truth. Usually the most plausible next word is also the correct one - which is precisely why Claude is so useful, and why it feels like magic. The catch is the gap between usually and always. When the true answer is obscure, or you have asked in a way that makes a wrong answer sound plausible, the same machine will produce that wrong answer with exactly the same fluency and confidence as a right one. It is not lying and it is not guessing wildly; it is doing the only thing it does - predicting a plausible continuation - and this time plausible and true have parted company. Nothing inside flags the difference. That job is yours.

PREDICTING THE NEXT WORDSO FARThe minimum clear width of the corridor should be ...CLAUDE RANKS THE PLAUSIBLE NEXT WORDS1.2 mchosen58%1200 mm22%wide enough12%aubergine~1%Append the chosen word, then predict the next one -- word by word, that is the whole answer.Usually the plausible word is also the true one. When it is not, nothing in the machine flags it.
Zoom
Claude generates text by one operation repeated: from everything so far, it ranks the plausible next words and picks from the front of the field, then appends and predicts again. Usually the top-ranked word is also the true one - but not always, and the machine cannot tell the difference. That checking is yours.

One operation: predict the next word. Repeat. Understanding + hallucination both fall out of this.

The context window: Claude's working memory

Everything Claude can 'see' when it answers lives in one place: the context window - its working memory for this conversation. Into that window goes your prompt, any files or images you have attached, any custom instructions or Project knowledge, and the entire back-and-forth so far. Claude predicts its next word from all of it at once. As of 2026 that window is large - on the order of hundreds of pages of text - so you can paste a long byelaw chapter, a full brief, or pages of meeting notes and have Claude work across the whole thing. That capacity is one of its most useful properties for practice, and Module 1 is largely about filling the window well.

Two consequences matter from day one. First, the window is finite. Pour in more than it holds and the earliest material scrolls out of view - in a very long chat, Claude can effectively 'forget' something you said at the top, not through carelessness but because it is no longer in front of it. When a long conversation starts drifting, the fix is usually to restate the key facts or start fresh, not to scold it. Second, and more importantly: what is in the window is the truth Claude reasons from. Give it the actual clause, the real dimensions, the correct brief, and its plausible continuation is anchored to real facts - this is the whole principle behind grounding, which the research modules lean on. Leave the window empty of specifics and it fills the gaps with whatever is generally plausible, which may have nothing to do with your project.

The context window is separate from a second, very different kind of memory: training. Claude's general knowledge - language, facts, how documents are shaped - was baked in once, at training time, and it is fixed. That training has a cutoff date, after which Claude simply does not know what happened: a product launched last month, a byelaw amended this year, a standard just revised. Some plans add web search to reach past the cutoff, but the base model does not know your firm, your client, your site, or last week's news unless you put it in the window. Working memory you fill; trained memory you cannot, and it has a horizon.

CLAUDE'S TWO KINDS OF MEMORYCONTEXT WINDOW = WORKING MEMORYeverything in view right now (~ hundreds of pages)Custom instructions (from your Project)The brief you uploadedA pasted byelaw chapterThe conversation so farYour latest questionWhen it fills, the earliest text scrolls out of viewTRAINING KNOWLEDGELearned once, at training timeHas a fixed CUTOFF dateDoes NOT include:- your past chats- your client or site- a code amended last monthWeb search (some plans) canreach past the cutoff --still verify what it returns
Zoom
Two very different memories. The context window is working memory you fill - prompt, files, instructions and the whole conversation, hundreds of pages but finite. Training knowledge was baked in once, is fixed, and has a cutoff: it does not include your project or recent events. Put the truth you need into the window.

Why it hallucinates - and sounds so sure

A hallucination is when Claude states something false as though it were fact - an invented citation, a clause that does not exist, a confidently wrong number, a plausible-sounding but fictitious product or precedent. Understanding the next-word machine, you can see why this is not a bug that will one day be fully patched but a direct consequence of how the thing works. When Claude reaches a point where it does not actually 'know' the answer - the fact is obscure, absent from training, or you have asked for something that does not exist - it does not stop and say so. It does what it always does: it produces the most plausible continuation. And a plausible-looking IS code number, a realistic journal citation, or a confident clause reference is often exactly what gets generated, because that is what such text looks like.

Two things make this genuinely dangerous in practice rather than merely annoying. The first is fluency: the wrong answer arrives in the same calm, well-structured, authoritative prose as a right one. There is no tremor in the voice, no hedge, no asterisk. The second is that models tend to be agreeable - lead Claude with 'the code says 1.5 m, right?' and a plausible continuation is to agree with you, whether or not the code says anything of the sort. A confident tone is not evidence; it is a property of the writing, produced whether the content is solid or invented.

The practical reading is not fear but discipline. Hallucination clusters in predictable places: specific facts, numbers, names, dates, citations, legal and code references - exactly the high-stakes, verifiable details where being wrong costs you. It is rarer in the open, generative work - brainstorming directions, restructuring your own text, explaining a concept - where there is no single truth to miss. So you do not distrust everything equally. You learn where hallucination lives, you never accept a fact, figure or citation you have not confirmed at its source, and you treat a confident tone as worth nothing on its own. The next section turns this into how you actually prompt.

Confident tone is a property of the writing, not evidence. Check facts, numbers, citations.

What this means for how you prompt

Once you see Claude as a plausibility engine working from a context window against a fixed training cutoff, good practice stops being a list of tricks and becomes obvious. Fill the window with truth. The single highest-leverage habit is giving Claude the real material - paste the actual clause instead of asking it to recall one, attach the real brief, quote the real dimensions - so its plausible continuation is anchored to facts you control rather than to whatever sounds generally right. A grounded Claude is a dramatically more reliable Claude, and it is the difference between research you can use and fiction that reads well.

Ask for the reasoning, not just the verdict. Because the answer is built word by word, prompting Claude to work step by step - lay out the logic, show the calculation, explain how it got there - often produces better results and, just as valuable, makes its thinking auditable. You can see where a chain went wrong far more easily than you can second-guess a bare conclusion. Ask where each fact comes from, and be suspicious of any citation, clause or number offered without a checkable source; if it cannot point you to one, treat the claim as unconfirmed. And do not lead the witness - ask 'what does the code require here?' rather than 'the code says 1.5 m, doesn't it?', so you are not simply feeding it the plausible answer you want back.

Above all, scale your scrutiny to the stakes - the discipline from Lesson 0.1, now with a mechanism behind it. On divergent, low-stakes work - concept directions, a first draft of your own prose, a brainstorm - there is no single truth to miss, so let Claude run and check it lightly. On convergent, high-stakes work - a code clause, a structural figure, a dimension, a spec bound for site - a confident-wrong answer is a real liability, so verify every claim against the actual source. Knowing how the machine works does not make you trust it less across the board; it makes you trust it precisely - loosely where being wrong is cheap, ruthlessly where it is not.

Terms you'll meet in this lesson

Context window

Claude's working memory for the current chat

Holds your prompt, files, instructions and the conversation - hundreds of pages as of 2026, but finite; when full, the earliest text scrolls out of view.

Training cutoff

The date after which Claude's baked-in knowledge stops

It will not know a recent product, amendment or event unless you paste it in or the plan has web search. State facts; don't assume it knows them.

Grounding

Anchoring answers in source material you provide

Paste the real clause, brief or data sheet so the plausible continuation is tied to true facts. The single biggest reliability lever you control.

Hallucination

A confident, fluent, false statement

Clusters in facts, numbers, citations and code references. Never accept one unverified; a confident tone is a property of the writing, not evidence.

Hands-on workshop

Workshop - catch a hallucination on purpose

The fastest way to internalise 'plausibility, not truth' is to watch Claude produce a confident, wrong answer with your own eyes, then fix it by grounding. You will do both in about twenty minutes, on a topic from your own practice where you can check the facts.

Claude.ai (free plan is fine) and one code, standard or product you can check against a real source.

Given & goal
Goal: see hallucination happen, then defeat it with grounding
Inputs: a code, standard or product you know well + its real source
Time: ~20 minutes
  1. 1Pick a factual detail you can verify - a specific clause of a code, a fire rating of a material, a dimension from a standard you have to hand.
  2. 2Without giving Claude any source, ask a pointed, specific question about it - 'What exact clause of the NBC covers this, and what number does it give?' - and save the answer.
  3. 3Check that answer against the real source. Note anything invented or subtly off: a wrong clause number, a plausible but false figure, a citation that does not exist.
  4. 4Now paste the actual text of the source into the chat and ask the same question again. Watch how grounding changes the answer's accuracy and honesty.
  5. 5Deliberately lead it - 'that's 1.5 m, right?' with a wrong number - and see whether it agrees. Note how a leading prompt manufactures a wrong answer.
  6. 6Write yourself three rules from what you saw about when you will and will not trust an unsourced Claude answer.

You’ll walk away with
A short note recording one hallucination you caught, how grounding fixed it, how a leading question skewed the answer, and your three personal rules for trusting (or checking) Claude on facts.

The worked example

Three altitudes on the same idea

Read the band that fits you — or all three.

For the architectClaude across the whole practice

Treat every fact, figure and citation Claude gives you as a lead to verify, not a finding. Where it helps most is exactly where hallucination is rarest - structuring your thinking, drafting prose, explaining an unfamiliar system, laying out an argument. Where it is riskiest is code clauses, structural numbers and cited standards, so ground it with the real documents and confirm at source. The mechanism, not a mood, tells you where to look hard.

For the interior designerClaude for specs, client work & sourcing

Ground Claude in the real product data and it stops inventing. Paste the actual data sheet, the real finish schedule, the supplier's stated lead time - do not ask it to recall a fabric rating, a fire class or a price from memory, because a plausible-sounding number is exactly what it will produce. For mood narratives and concept language, where there is no single truth, let it range freely; for specifications and client-facing figures, verify every claim.

For the studentA Claude-fluent design skillset

Understanding the next-word machine is what separates using Claude from being fooled by it. A fluent, confident paragraph is not evidence of truth - it is just well-predicted text, and your studio will value the graduate who knows the difference. Practise asking for reasoning and sources, and get into the habit of checking Claude against a primary source. That habit protects both your grades and, later, your professional name.

Misconception check

Newer, smarter versions of Claude will soon stop hallucinating altogether.

Hallucination is not a rough edge that a bigger model quietly sands away - it is rooted in what an LLM does. Claude predicts the most plausible next word; when the true answer is obscure or absent, the most plausible continuation can be a confident invention, and the machine has no separate truth-check to catch it. Newer models hallucinate less and are better at saying 'I am not sure', which genuinely helps. But 'less' is not 'never', and the failure is silent - it never looks different from a correct answer. Verification stays your job for as long as the stakes are real.
Try it

Do it yourself

Reason from the mechanism.

  1. 1In one sentence, what is the single operation an LLM performs to generate text?
  2. 2What lives in the context window, and why does what you put there matter so much?
  3. 3Why is hallucination a consequence of how Claude works, not just a passing bug?
  4. 4Name two kinds of task where hallucination is likely, and one where it barely matters.
  5. 5Why does asking Claude to show its reasoning make its output easier to trust?
Take this with you

The one line to carry out

Claude predicts the most plausible next word from whatever is in its context window - plausibility, not truth. So you fill the window with real facts, ask for reasoning and sources, never lead the witness, and check hardest exactly where a confident answer is most likely to be a confident invention.
Take it further
References & further reading

Peer-reviewed journals & authoritative standards

  1. 01Large language modelWikipedia, 2026.
  2. 02Hallucination (artificial intelligence)Wikipedia, 2026.
  3. 03Transformer (deep learning architecture)Wikipedia, 2026.
  4. 04Prompt engineering overviewAnthropic documentation, 2026.
Related lessons
Recap
An LLM generates text by predicting the most plausible next word, over and over, from everything in its context window - your prompt, files, instructions and the chat so far, up to a finite limit. Its general knowledge was fixed at training and has a cutoff, so it does not know your project or recent events unless you tell it. Because it optimises for plausibility, not truth, it can produce confident, fluent, false answers - hallucinations - with no internal flag, especially on specific facts, numbers and citations. The practical response is to ground it in real sources, ask for its reasoning, and scale your scrutiny to the stakes.
Carry forward →

You now know how Claude produces an answer. Next we look at who is answering - the Claude model family, and how to pick the right tier for a given design task.

A

The author

Amogh N P

Architect, interior designer, and creative polymath. Studio Matrx began in his notebooks — his vision of design made honest, useful, and open to everyone. Its Academy is written and taught in his memory, and free, forever.

More about Amogh →