Advances in AI Security and Risk Assessment

The field of AI security and risk assessment is rapidly evolving, with a growing focus on addressing the unique challenges posed by adversarial machine learning threats and cognitive cybersecurity vulnerabilities. Researchers are developing innovative frameworks and methodologies to quantify and mitigate these risks, such as comprehensive risk assessment frameworks and vision-first architectures for robust web agents. Noteworthy papers in this area include CIA+TA Risk Assessment for AI Reasoning Vulnerabilities, which introduces a quantitative risk assessment methodology for cognitive security risks, and FRAME, which presents a comprehensive and automated framework for assessing adversarial machine learning risks. Additionally, WebSight: A Vision-First Architecture for Robust Web Agents proposes a novel architecture for interacting with web environments through visual perception, and CORTEX introduces a multi-layered risk scoring framework for assessing AI system vulnerabilities.

Sources

CIA+TA Risk Assessment for AI Reasoning Vulnerabilities

Uplifted Attackers, Human Defenders: The Cyber Offense-Defense Balance for Trailing-Edge Organizations

A Functionality-Grounded Benchmark for Evaluating Web Agents in E-commerce Domains

WebSight: A Vision-First Architecture for Robust Web Agents

FRAME : Comprehensive Risk Assessment Framework for Adversarial Machine Learning Threats

CORTEX: Composite Overlay for Risk Tiering and Exposure in Operational AI Systems

Just Dork and Crawl: Measuring Illegal Online Gambling Defacement in Indonesian Websites

Every Keystroke You Make: A Tech-Law Measurement and Analysis of Event Listeners for Wiretapping

Network-Level Prompt and Trait Leakage in Local Research Agents

Surveying the Operational Cybersecurity and Supply Chain Threat Landscape when Developing and Deploying AI Systems

Guarding Against Malicious Biased Threats (GAMBiT) Experiments: Revealing Cognitive Bias in Human-Subjects Red-Team Cyber Range Operations

Built with on top of