Anthropic reportedly A/B tests lower effort levels in Claude Code
anthropic claude
| Source: HN | Original article
Anthropic is A/B testing lower effort settings in its Claude Code tool, adjusting the balance between processing depth and response speed.
Anthropic is quietly running an A/B test that lowers the “effort level” settings in its Claude Code developer tool. The test, first flagged by a paying subscriber and reported in March, reduces the amount of compute the model uses at run‑time, trimming output length, disabling context sections and capping code snippets at roughly 40 lines. Users on the $20‑per‑month Pro plan have described the change as a sudden degradation of the service they rely on for professional coding assistance.
The move matters because Claude Code’s effort levels—low, medium, high and max—are marketed as a trade‑off between speed, cost and output quality. By shifting users to a lower point on the test‑time‑compute curve without clear notice, Anthropic risks undermining confidence in a product that commands premium pricing. The lack of transparency also raises broader questions about how AI firms experiment with core functionality in paid services, a topic that has already drawn criticism from developers and could attract regulatory scrutiny.
Anthropic’s internal guidance, published in April, acknowledges that effort levels are calibrated to balance latency and usage limits, but it does not explain why a subset of users would be nudged toward a reduced setting. The company has not yet commented publicly on the specific test.
What to watch next: whether Anthropic issues a formal statement or adjusts the rollout, and how it communicates future effort‑level changes to paying customers. The episode could feed into wider concerns about AI‑product governance that have surfaced alongside Anthropic’s recent IPO filing. Continued user feedback and any regulatory response will indicate whether the experiment remains a technical tweak or becomes a flashpoint for trust in commercial AI tools.
Sources
Back to AIPULSEN