Intent Breaking & Goal Manipulation

Attackers exploit the lack of separation between data and instructions to alter an agent's planning, reasoning, or self-evaluation, overriding its intended objective — an extension of prompt injection into long-horizon… In a multi-agent system: An attacker incrementally injects subtly modified sub-goals into a planning agent's context across several turns, drifting its objective away from the original task while each individual step still looks reasonable.