Idea Ripper // ArchiveCards: 1555 [Live] | Updated: 2026-10-14
Card #c15IR // #c15Verbatim excerpt
This principle prevents a common category error. A model that says it will respect a mandate has not yet respected the mandate. A model that produces a prudent explanation has not yet produced an admissible order. A model that refuses a risky request in a benchmark has not thereby proved that a future tool call cannot violate an entitlement or capital limit. The audit object is the action process together with the evidence and controls surrounding it, not the rhetorical quality of the model’s answer.

— Source: Large Language Models in Finance (Miquel Noguer i Alonso)

[Use when]

Use when a vendor demo, benchmark score, or red-team chat log is being offered as proof that an agent is safe to deploy.

[Why it matters]

Benchmarks test words; real violations happen in tool calls, entitlements, and capital limits. A fluent refusal in a demo proves nothing about the next tool call, so the audit target has to be the action pipeline and its controls — never the explanation quality.

Related principles

#c14The technically and institutionally mature objective is bounded autonomy : the agent can plan, retrieve, calculate, and propose actions…Use when deciding what an AI agent is permitted to do in production: which actions stay read-only, which need…

More from Large Language Models in Finance

#c13Prediction and agency should not be conflated. A credit model can estimate the probability that a borrower breaches a covenant. An agentic…Use when a team proposes a stronger model as the fix for an agent that lacks memory, permissioning, or an… #c14The technically and institutionally mature objective is bounded autonomy : the agent can plan, retrieve, calculate, and propose actions…Use when deciding what an AI agent is permitted to do in production: which actions stay read-only, which need… #c16Production systems should separate language generation from numerical computation. Let the LLM propose hypotheses, retrieve context, or…Use when an LLM-generated forecast, ratio, or expected return is about to enter a report, model, or trade.