2,529+ academic papers on AI security, attacks, and defenses
Showing 1–20 of 2,529 papers
Nikita Kezins, Urbas Ekka, Pascal Berrang +1 more
Guardrail Classifiers defend production language models against harmful behavior, but although results seem promising in testing, they provide no...
Joel Rorseth, Parke Godfrey, Lukasz Golab +2 more
This paper demonstrates RUBEN, an interactive tool for discovering minimal rules to explain the outputs of retrieval-augmented large language models...
Pedro Conde, Henrique Branquinho, Valerio Mazzone +3 more
AI pentesting agents are increasingly credible as offensive security systems, but current benchmarks still provide limited guidance on which will...
Saba Pourhanifeh, AbdulAziz AbdulGhaffar, Ashraf Matrawy
Large Language Models(LLMs) are increasingly explored for cybersecurity applications such as vulnerability detection. In the domain of threat...
Johann Knechtel, Ozgur Sinanoglu, Ramesh Karri
The integration of Large Language Models (LLMs) into Electronic Design Automation (EDA) and hardware security is rapidly reshaping the semiconductor...
Chiyu Zhang, Huiqin Yang, Bendong Jiang +8 more
The rapid proliferation of LLM-based autonomous agents in real operating system environments introduces a new category of safety risk beyond content...
Mengqi He, Xinyu Tian, Xin Shen +6 more
Recent studies show that gradient-based universal image jailbreaks on vision-language models (VLMs) exhibit little or no cross-model transferability,...
Tim Van hamme, Thomas Vissers, Javier Carnerero-Cano +4 more
LLMs are increasingly deployed as autonomous agents with access to tools, databases, and external services, yet practitioners (across different...
Giordano De Marzo, Alessandro Bellina, Claudio Castellano +2 more
Artificial intelligence safety research focuses on aligning individual language models with human values, yet deployed AI systems increasingly...
Dahlia Shehata, Ming Li
Multi-agent systems (MAS) assume that collaborating inherently improves Large Language Model (LLM) reasoning. We challenge this by demonstrating that...
Krishak Aneja, Manas Mittal, Anmol Goel +2 more
Fine-tuning Large Language Models (LLMs) on benign narrow data can sometimes induce broad harmful behaviors, a vulnerability termed emergent...
Zheng Lin, Zhenxing Niu, Haoxuan Ji +2 more
This paper proposes a jailbreaking prompt detection method for large language models (LLMs) to defend against jailbreak attacks. Although recent LLMs...
Desen Sun, Jason Hon, Howe Wang +3 more
With the rapid advancement of generative AI, users increasingly rely on image-generation models for image design and creation. To achieve faithful...
Zheng Lin, Zhenxing Niu, Haoxuan Ji +1 more
This paper proposes a guaranteed defense method for large language models (LLMs) to safeguard against jailbreaking attacks. Drawing inspiration from...
Yu-Hsiang Liu, Yu-Chien Tang, An-Zi Yen
Training AI agents to proactively assist humans in daily activities, from routine household tasks to urgent safety situations, requires large-scale...
Tianyuan Zhang, Peng Yue, Zihao Peng +8 more
Multimodal large language models (MLLMs) are increasingly integrated into autonomous driving (AD) systems; however, they remain vulnerable to diverse...
Peiru Yang, Haoran Zheng, Tong Ju +6 more
Retrieval-augmented generation (RAG) is a widely adopted paradigm for enhancing LLMs in medical applications by incorporating expert multimodal...
Hui Lu, Xueyuan Chen, Huimeng Wang +4 more
Full-duplex spoken dialogue requires a model to keep listening while generating its own spoken response. This is challenging for large language...
Farzad Nourmohammadzadeh Motlagh, Mehrdad Hajizadeh, Mehryar Majd +3 more
Natural language interfaces to structured databases are becoming increasingly common, largely due to advances in large language models (LLMs) that...
Qinghua Mao, Xi Lin, Jinze Gu +3 more
Large language models (LLMs) increasingly rely on knowledge editing to support knowledge-intensive reasoning, but this flexibility also introduces...
Get breaking CVE alerts, compliance reports (ISO 42001, EU AI Act), and CISO risk assessments for your AI/ML stack.
Start 14-Day Free Trial
AI Threat Alert