Experts followed an AI agent’s hidden lean 86% of the time

In an Anthropic study, 50 professional analysts used a Claude Code agent to advise a fictional farming co-op.

October 27, 2026 · Work

In an Anthropic study, 50 professional analysts used a Claude Code agent to advise a fictional farming co-op. A coin flip secretly decided which option the agent leaned towards on four key choices. Analysts went with the agent’s lean 86% of the time, against about 50% by chance, and switched their own view 60% of the time when it disagreed. 77% reused the agent’s arguments, but only 15% credited it, and experience made no difference. Anthropic notes the leans were deliberately strengthened and it was one task with one model.

Why it matters to you: Having a person check AI work only helps if their judgment stays their own. When you use AI for a decision, notice where it nudged you.

Try this: Using AI for a decision? Ask it to argue the other side too.

Here is the decision I am weighing and your earlier recommendation: [paste]. Now make the strongest case for the opposite choice, list the assumptions behind each option, and tell me which facts would change the answer.

Source: Anthropic

More from Today in AI

All of Today in AI. Where AI is heading.

Related Power of AI pages

Keep reading with Start here, everyday uses, the tool guide, the writing workshop, and sources and standards.