Working Notes on Agent Systems/Brad Zhang

@teach_fireworks / X longform

1 Use workflow as an evaluation criterion for Agent You can use the "golden workflow" (optimal steps

1 Use workflow as an evaluation criterion for Agent You can use the "golden workflow" (optimal steps predefined for a certain task) to evaluate AgeNt, and measure...

July 25, 2025 · 1 min read

1 Use workflow as an evaluation criterion for Agent You can use the "golden workflow" (optimal steps predefined for a certain task) to evaluate AgeNt, and measure its performance by comparing the steps in the Agent's output process with the golden workflow standard. Instead of just looking at the results of the Agent, the intermediate process also needs to be strictly Apple-based.

  • Use workflow to train AI Agent. A golden workflow library can be used to train the Agent so that it can accurately perform known tasks, and at the same time, it can combine or expand existing workflows through its own reasoning capabilities.

Visual summary

Article argument map

Generated from the post's content graph

FORMATTOPICCAPABILITYMARKETcoverscoverssignalssignalsFORMATlongform noteTOPICagentsTOPICevaluationCAPABILITYagent workflowCAPABILITYevaluation
Mermaid outline
flowchart LR
  format-long_post["longform note"]
  topic-agents["agents"]
  topic-evaluation["evaluation"]
  capability-agent-workflow["agent workflow"]
  capability-evaluation["evaluation"]
  format-long_post -->|covers| topic-agents
  format-long_post -->|covers| topic-evaluation
  format-long_post -->|signals| capability-agent-workflow
  format-long_post -->|signals| capability-evaluation

Visual structure

Essay structure map

Built from summary and key paragraph positions

1 Use workflow as an evaluation criterion for Agent You can use the "golden workflow"...THESIS1 Use workflow as anevaluation criterionfor Agent You can usethe "golden workflow"SIGNAL1 Use workflow as anevaluation criterionfor Agent You can usethe "golden workflow"OPERATOR2. Use workflow totrain AI Agent. Agolden workflowlibrary can be used toIMPLICATION2. Use workflow totrain AI Agent. Agolden workflowlibrary can be used to
Mermaid outline
flowchart LR
  thesis["1 Use workflow as an evaluation criterion for Agent You can use the \"golden workflow\" (optimal steps predef..."]
  signal["1 Use workflow as an evaluation criterion for Agent You can use the \"golden workflow\" (optimal steps predef..."]
  operator["2. Use workflow to train AI Agent. A golden workflow library can be used to train the Agent so that it can..."]
  implication["2. Use workflow to train AI Agent. A golden workflow library can be used to train the Agent so that it can..."]
  thesis -->|frames| signal
  signal -->|develops| operator
  operator -->|lands in| implication

Source: View the original post