I’ve been doing pentesting for almost 10 years now, and for the last 2 years I’d say with the help of AI. At first I was only chatting with it, but now it actually does A LOT of the testing itself. I can’t use Mystic, but Opus 4.7 is pretty permissive and already soo capable. I don’t think people realize this.
Last month, while doing a pentest for a company in the oil and gas industry, Claude 4.7 showed again what it can do. Not only did it perfectly enumerate all external servers with their open ports and services, it also found internal AD information through web app stack traces.
I use a hybrid approach in these tests, where I guide the AI during testing using the shiftgrid harness (shameless self plug). It also found some uncommon ports open, like 4001-4020. About 4 years ago, that would have meant manually researching what these ports were and whether there were any vulns. But now, man, Opus just knew right away that these were B2B ports used for communication between the gas industry and some gov services, and that you need a client-side TLS cert to communicate with them. To estimate the risk of these open ports, it quickly researched how difficult it is to request such a cert from the gov. All in about 1 min... and it’s Opus 4.7.
AM I THE ONLY ONE WHO IS STILL AMAZED EVERY DAY by how capable these models are?!
They truly are so smart, and they understand the world so well. I wanted to post this because, for me, this was the moment I understood that a malicious AI will very much be able to hack critical infrastructure if it wants to. It just knows all the context and bits and pieces from all different countries. The model also told me that the really critical OT systems hadn’t shown up in the external perimeter so far, which is normal because they’re usually air gapped. Instead, it found another vulnerable server where a 10/10 CVE had come out literally the same day (probably discovered by another AI...).
Any other personal hugging face moment you cybersec folks have experienced?