Compositional Safety Failures in Harness Evolution: Identification and Runtime Monitoring
Researchers show that self-evolving agent harnesses can become unsafe when individually safe updates to memory, prompts, skills and tools interact. They found 43 pairwise and 18 irreducible 3-way failures and propose a typed hypergraph with runtime monitoring that lowers checking costs.
— via arXiv Software Engineering, Zhixiang Zhang, Zesen Liu, Wai Ip Lai, Hongxu chen, Dongdong She