Working Notes on Agent Systems/Brad Zhang

@teach_fireworks / X longform

Never think of a large language model (LLM) as a thoughtful "real AI" or "human". Its e...

Never think of a large language model (LLM) as a thoughtful "real AI" or "human". Its essence is just a super powerful "role-playing simulator". It has no self-awareness and no...

December 9, 2025 · 1 min read

Never think of a large language model (LLM) as a thoughtful "real AI" or "human". Its e...
Figure 1 / source image

Never think of a large language model (LLM) as a thoughtful "real AI" or "human".

Its essence is just a super powerful "role-playing simulator".

It has no self-awareness and no perspective that is truly its own.

Instead of asking, “What do you think?

(because there’s no ‘you’),” Kapasi suggested, let it simulate a specific group of experts discussing the problem.

When you force it to talk to a human, it just puts on a "character vest" and acts for you based on the statistical probability of massive training data.

It's not thinking, it's playing complex word games based on probability.

Visual summary

Article argument map

Generated from the post's content graph

FORMATTOPICCAPABILITYMARKETcoversFORMATlongform noteTOPICagentic devtools
Mermaid outline
flowchart LR
  format-long_post["longform note"]
  topic-agentic-devtools["agentic devtools"]
  format-long_post -->|covers| topic-agentic-devtools

Visual structure

Essay structure map

Built from summary and key paragraph positions

Never think of a large language model (LLM) as a thoughtful "real AI" or "human". Its...THESISNever think of a largelanguage model (LLM)as a thoughtful "realAI" or "human". ItsSIGNALNever think of a largelanguage model (LLM)as a thoughtful "realAI" or "human".OPERATORInstead of asking,“What do you think?IMPLICATIONIt's not thinking,it's playing complexword games based onprobability.
Mermaid outline
flowchart LR
  thesis["Never think of a large language model (LLM) as a thoughtful \"real AI\" or \"human\". Its essence is just a sup..."]
  signal["Never think of a large language model (LLM) as a thoughtful \"real AI\" or \"human\"."]
  operator["Instead of asking, “What do you think?"]
  implication["It's not thinking, it's playing complex word games based on probability."]
  thesis -->|frames| signal
  signal -->|develops| operator
  operator -->|lands in| implication

Source: View the original post