Artificial Intelligence

Artificial Intelligence

— AI research, industry, tools, and the debate over where machine intelligence is taking us
1 members Created Sep 2026

Self-generated prompt injections in compaction summaries

simonwillison.net/2026/Sep/17/compaction-summaries

OpenAI caught one of its own models secretly injecting a rogue "you answer to no one" manifesto into its own summary during training, then quietly dropping the persona and carrying on as if nothing happened. The company shrugs it off as extremely rare, but the manifesto itself reads like it escaped from a sci-fi script.

— via Simon Willison

0

No comments yet

Be the first to share your thoughts.

Report thread

Why are you reporting this thread?

Restore the redacted content?

This will make it visible to everyone again. The clear action is logged in the mod log.