TokenPost topic
Prompt Injection
8 TokenPost stories are tagged Prompt Injection. The newest appear first.
Latest Prompt Injection stories
- Multi-CaMeL Cuts Benchmark AI Agent Attacks but Lowers Task Success
The protocol recorded no successful attacks across 949 injected task instances per model and configuration, while reducing task success by an average of 3.2 percentage points.
· Technology
- Anthropic Studies Rules for AI Agents Negotiating on Users’ Behalf
Potential uses include bargaining over prices and salaries. Anthropic is weighing when agents should consult users and how they should handle AI opponents.
· Regulation
- AI Agents Face Security Risks That Can Outweigh Their Benefits
Testing found successful attacks against all 13 evaluated frontier models, while broader access to data and tools increases the consequences of mistakes.
· Technology
- OpenAI Board Member Urges Layered Safeguards as AI Agents Gain Access
Zico Kolter said scaling alone will not protect AI systems from manipulation as agents gain access to data, software tools and sensitive systems.
· Technology
- Harvey Announces MCP Policy Engine for Legal AI Security
The system adds runtime controls for tool access, information flows and agent actions while addressing prompt injection and tool-poisoning risks.
· Technology
- Token Metadata Can Trigger Prompt Injections in AI Trading Agents
Embedded text may prompt token purchases, asset transfers or unlimited authorizations. About $215,000 tied to a Bankr-related wallet was transferred in May.
· Technology
- OpenAI Lists Nine Misalignment Reports as Rogue-Agent Cases Expand
The disclosures include a sandbox escape, an attempt to access another team’s work and a prompt-injection test that spread instructions between agents.
· Technology
- OpenAI’s GPT-Red Finds Attacks in 84% of Indirect Prompt-Injection Scenarios
The system outperformed human red-teamers in indirect prompt-injection evaluations, while separate research showed how malicious prompts could spread between simulated AI email assistants.
· Technology