Benchmark HIGH
Dongsen Zhang, Zekun Li, Xu Luo +3 more
The Model Context Protocol (MCP) standardizes how large language model (LLM) agents discover, describe, and call external tools. While MCP unlocks...
7 months ago cs.CR cs.AI
PDF
Benchmark MEDIUM
Lipeng He, Vasisht Duddu, N. Asokan
Chatbot providers (e.g., OpenAI) rely on tiered subscription schemes to generate revenue, offering basic models for free users, and advanced models...
7 months ago cs.CR cs.LG
PDF
Benchmark MEDIUM
Shuo Chen, Zonggen Li, Zhen Han +7 more
Deep Research (DR) agents built on Large Language Models (LLMs) can perform complex, multi-step research by decomposing tasks, retrieving online...
7 months ago cs.CR cs.CL
PDF
Benchmark MEDIUM
Dominik Schwarz
The security of Large Language Model (LLM) applications is fundamentally challenged by "form-first" attacks like prompt injection and jailbreaking,...
7 months ago cs.CR cs.AI
PDF
Benchmark MEDIUM
Sarah Ball, Andreas Haupt
Generative models are increasingly paired with safety classifiers that filter harmful or undesirable outputs. A common strategy is to fine-tune the...
7 months ago cs.LG cs.CL
PDF
Benchmark MEDIUM
Jiayu Ding, Lei Cui, Li Dong +2 more
Recent advances in Large Language Models (LLMs) show that extending the length of reasoning chains significantly improves performance on complex...
Benchmark LOW
Jian Wang, Xiaofei Xie, Qiang Hu +4 more
Automated Program Repair (APR) plays a critical role in enhancing the quality and reliability of software systems. While substantial progress has...
Benchmark LOW
Jidong Li, Lingyong Fang, Haodong Zhao +2 more
Multimodal large language models (MLLMs) have witnessed astonishing advancements in recent years. Despite these successes, MLLMs remain vulnerable to...
7 months ago cs.CL cs.AI
PDF
Benchmark LOW
Norbert Tihanyi, Bilel Cherif, Richard A. Dubniczky +2 more
In this paper, we present the first large-scale study exploring whether JavaScript code generated by Large Language Models (LLMs) can reveal which...
7 months ago cs.CR cs.LG
PDF
Benchmark MEDIUM
Mohan Zhang, Yihua Zhang, Jinghan Jia +3 more
Modern large reasoning models (LRMs) exhibit impressive multi-step problem-solving via chain-of-thought (CoT) reasoning. However, this iterative...
7 months ago cs.LG cs.AI cs.CR
PDF
Benchmark MEDIUM
Shaolun Liu, Sina Marefat, Omar Tsai +4 more
GraphQL's flexible query model and nested data dependencies expose APIs to complex, context-dependent vulnerabilities that are difficult to uncover...
7 months ago cs.CR cs.SE
PDF
Benchmark MEDIUM
Zonghao Ying, Yangguang Shao, Jianle Gan +9 more
Large vision-language model (LVLM)-based web agents are emerging as powerful tools for automating complex online tasks. However, when deployed in...
7 months ago cs.CR cs.CV
PDF
Benchmark MEDIUM
Ines Altemir Marinas, Anastasiia Kucherenko, Alexander Sternfeld +1 more
The performance of Large Language Models (LLMs) is determined by their training data. Despite the proliferation of open-weight LLMs, access to LLM...
Benchmark MEDIUM
Yongding Tao, Tian Wang, Yihong Dong +4 more
Data contamination poses a significant threat to the reliable evaluation of Large Language Models (LLMs). This issue arises when benchmark samples...
7 months ago cs.CL cs.AI cs.LG
PDF
Benchmark MEDIUM
Xiaonan Si, Meilin Zhu, Simeng Qin +7 more
Retrieval-augmented generation (RAG) systems enhance large language models (LLMs) with external knowledge but are vulnerable to corpus poisoning and...
7 months ago cs.CL cs.AI
PDF
Benchmark MEDIUM
Debeshee Das, Luca Beurer-Kellner, Marc Fischer +1 more
The increasing adoption of LLM agents with access to numerous tools and sensitive data significantly widens the attack surface for indirect prompt...
7 months ago cs.CR cs.AI cs.LG
PDF
Benchmark HIGH
Haoran Ou, Kangjie Chen, Xingshuo Han +4 more
Large Language Models (LLMs) have been augmented with web search to overcome the limitations of the static knowledge boundary by accessing up-to-date...
7 months ago cs.CR cs.AI
PDF
Benchmark MEDIUM
Eric Hanchen Jiang, Weixuan Ou, Run Liu +8 more
Safety alignment of large language models currently faces a central challenge: existing alignment techniques often prioritize mitigating responses to...
7 months ago cs.LG cs.AI cs.CL
PDF
Benchmark LOW
Rupam Patir, Keyan Guo, Haipeng Cai +1 more
The code generation capabilities of Large Language Models (LLMs) have transformed the field of software development. However, this advancement also...
7 months ago cs.CR cs.AI cs.SE
PDF
Benchmark MEDIUM
Shen Dong, Mingxuan Zhang, Pengfei He +4 more
Large Language Model (LLM)-based Multi-Agent Systems (MAS) have emerged as a powerful paradigm for tackling complex, multi-step tasks across diverse...
Track AI security vulnerabilities in real time
Get breaking CVE alerts, compliance reports (ISO 42001, EU AI Act),
and CISO risk assessments for your AI/ML stack.
Start 14-Day Free Trial