As reported by Simon Willison, this experiment underscores a critical tension in applying generative AI to deep research: the models appear to require significant human steering to overcome a built-in bias toward assuming certain problems are unsolvable. This suggests that, for now, the value proposition lies less in autonomous discovery and more in amplifying a human researcher's capacity to explore more permutations of an idea. The high compute cost for what is framed as a proof-of-concept also indicates that such approaches may remain a niche tool for well-resourced labs rather than a democratizing force in security research, at least until efficiency improves dramatically.
Claude AI reportedly guided to find cryptographic flaws through intensive prompting
Anthropic's Claude model was reportedly directed to discover novel cryptographic attacks after extensive human encouragement.
AIpressr commentary on an article originally published by Simon Willison.
For informational purposes only. AI-assisted commentary may contain errors. full disclaimer ↓hide ↑
This is AIpressr's editorial commentary on a report originally published by another outlet — it is opinion, not the original reporting, and not an endorsement by or affiliation with that outlet. Follow the linked source for the underlying facts. Editorial & AI disclosure.
Editor's Take
Simon Willison highlights an experiment where Anthropic's Claude model was reportedly prompted for 60 hours to find cryptographic weaknesses. The reported cost of this exercise, estimated at $100,000 in API calls, raises immediate questions about the economic viability and practical utility of using current LLMs for original cryptanalysis. The core claim, that the model needed persistent human encouragement to pursue 'genuinely hard findings' rather than 'low-hanging fruit,' suggests these systems still lack the intrinsic curiosity and problem-framing ability of top human researchers.
“the main human interventions were to encourage it not to give up and 'find something that worth publishing'.”
Our analysis
Have AI news to share?
Submit your release →Publisher or subject of this story? Object to this commentary or request a correction →
