36 points | by glub 3 hours ago ago
4 comments
Any testing of cyber capability in a sandbox should be prefaced with a test where the model is tasked with escaping the sandbox ;)
Smoke out those misconfigurations while the model only needs to escape, not do anything once out.
Wait, is Irregular the same company that caused the Anthropic incident?
yes
Now that is a vague headline. Is the secret ingredient crime?
Any testing of cyber capability in a sandbox should be prefaced with a test where the model is tasked with escaping the sandbox ;)
Smoke out those misconfigurations while the model only needs to escape, not do anything once out.
Wait, is Irregular the same company that caused the Anthropic incident?
yes
Now that is a vague headline. Is the secret ingredient crime?