Microsoft drops realistic benchmark for cybersecurity AI
Microsoft just launched ExCyTIn-Bench, an open-source benchmark testing AI agents inside simulated security operations centers with 57 live log tables. In testing, GPT-5 with high reasoning led with a 56.2% score, but dropping its reasoning depth tanked performance by nearly 19%. Why it matters: Static Q&A tests are useless for infosec—defenders now have a reliable way to see if an AI agent can actually investigate complex threats.