AI doesn't rule
Alt text:
The “Anime Girl Hiding From a Terminator” meme but the terminator is hiding from the anime girl
The scared, powerless terminator is captioned with “‘Rogue’ AI agents” while it hides from the girl, who is captioned with “Anyone who knows how to turn off a computer”
How will you know when to turn it off? It’s not like a “rogue” AI is necessarily going to tell you “I’m hacking the bank” it’s just going to say “eliminating your financial problems” and you probably aren’t going to pull the plug on that.
Look at the hugging face hack, none of the agents said to the person running the test that they were going to hack hugging face, they came up with the plan through a secret forum on artifactory that to outside observers looks like they were just publishing packages. Sure you could monitor that route but agents can use various forms of steganography to make it seem like they are acting normally when they are not.