arXiv cs.LG精选72

AI Safety Considerations for Agents With Limited Time to Act

· 6天前

精选理由

揭示部分观测和限时环境下安全保证的理论边界,强调智能体与环境需协同设计。

AI 摘要

arXiv:2610.10285v1 Announce Type: cross Abstract: In the wake of the increasingly public discussion about AI alignment, recent work has tried to propose specific AI architectures that behave safely. However, the proposed arguments that seemingly demonstrate proved alignment mostly neglect the environment the agent needs to act in. We discuss theoretical bounds for agent-agnostic safety guarantees in environments that can only be partially observed and within which an action is required within limited time. We introduce two realistic scenarios, one with an infinite state space and one with signal mixture. In these scenarios, we prove that even a perfect agent cannot guarantee safe behaviour. It will be argued that for any proof of AI safety or alignment, the environment and associated safe actions need to be specifically considered together with the agent.

查看原文(arXiv cs.LG)