VisualDAN: Exposing Vulnerabilities in VLMs with Visual-Driven DAN Commands
Aofan Liu, Lulu Tang
Vision-Language Models (VLMs) have garnered significant attention for their remarkable ability to interpret and generate multimodal content. However,...
AI Threat Alert indexes 3,023+ peer-reviewed and preprint papers on AI/ML security — covering adversarial attacks, model defenses, red-teaming benchmarks, surveys, and security tooling. Papers are sourced from arXiv, classified by type and by relevance to real-world threats, and cross-referenced with the CVEs and incidents they relate to.
Showing 2781–2800 of 3,023 papers
Aofan Liu, Lulu Tang
Vision-Language Models (VLMs) have garnered significant attention for their remarkable ability to interpret and generate multimodal content. However,...
Muxi Diao, Yutao Mou, Keqing He +6 more
The safety of Large Language Models (LLMs) is crucial for the development of trustworthy AI applications. Existing red teaming methods often rely on...
Jiyang Qiu, Xinbei Ma, Yunqing Xu +2 more
The rapid deployment of large language model (LLM)-based agents in real-world applications has raised serious concerns about their trustworthiness....
Stanisław Pawlak, Jan Dubiński, Daniel Marczak +1 more
Model merging (MM) recently emerged as an effective method for combining large deep learning models. However, it poses significant security risks....
Haoran Ou, Kangjie Chen, Xingshuo Han +4 more
Large Language Models (LLMs) have been augmented with web search to overcome the limitations of the static knowledge boundary by accessing up-to-date...
Kazuki Egashira, Robin Staab, Thibaud Gloaguen +2 more
Model pruning, i.e., removing a subset of model weights, has become a prominent approach to reducing the memory footprint of large language models...
Xiangtao Meng, Tianshuo Cong, Li Wang +4 more
Large Language Models (LLMs) have shown remarkable performance across various applications, but their deployment in real-world settings faces several...
Weisen Jiang, Sinno Jialin Pan
This paper introduces MetaDefense, a novel framework for defending against finetuning-based jailbreak attacks in large language models (LLMs). We...
Eric Hanchen Jiang, Weixuan Ou, Run Liu +8 more
Safety alignment of large language models currently faces a central challenge: existing alignment techniques often prioritize mitigating responses to...
Renhua Ding, Xiao Yang, Zhengwei Fang +3 more
Large vision-language models (LVLMs) enable autonomous mobile agents to operate smartphone user interfaces, yet vulnerabilities in their perception...
Man Hu, Xinyi Wu, Zuofeng Suo +5 more
With the rise of advanced reasoning capabilities, large language models (LLMs) are receiving increasing attention. However, although reasoning...
Chongyu Fan, Changsheng Wang, Yancheng Huang +2 more
Machine unlearning for large language models (LLMs) aims to remove undesired data, knowledge, and behaviors (e.g., for safety, privacy, or copyright)...
Rupam Patir, Keyan Guo, Haipeng Cai +1 more
The code generation capabilities of Large Language Models (LLMs) have transformed the field of software development. However, this advancement also...
Shen Dong, Mingxuan Zhang, Pengfei He +4 more
Large Language Model (LLM)-based Multi-Agent Systems (MAS) have emerged as a powerful paradigm for tackling complex, multi-step tasks across diverse...
Christos Ziakas, Nicholas Loo, Nishita Jain +1 more
Automated red-teaming has emerged as a scalable approach for auditing Large Language Models (LLMs) prior to deployment, yet existing approaches lack...
Abhishek Anand, Matthias C. Caro, Ari Karchmer +1 more
Quantum learning from remotely accessed quantum compute and data must address two key challenges: verifying the correctness of data and ensuring the...
Junjie Li, Fazle Rabbi, Bo Yang +2 more
Although Large Language Models (LLMs) show promising solutions to automated code generation, they often produce insecure code that threatens software...
Artur Horal, Daniel Pina, Henrique Paz +7 more
This paper presents the vision, scientific contributions, and technical details of RedTWIZ: an adaptive and diverse multi-turn red teaming framework,...
Muris Sladić, Veronica Valeros, Carlos Catania +1 more
There are very few SotA deception systems based on Large Language Models. The existing ones are limited only to simulating one type of service,...
Riku Mochizuki, Shusuke Komatsu, Souta Noguchi +1 more
We analyze answers generated by generative engines (GEs) from the perspectives of citation publishers and the content-injection barrier, defined as...
AI security research studies how AI and machine-learning systems can be attacked and defended — covering adversarial examples, prompt injection, model poisoning, training-data extraction, and the mitigations against them. AI Threat Alert curates this research from academic sources so security teams can track the threats behind emerging AI risks.
AI Threat Alert indexes 3,023+ papers on AI/ML security, classified across attack, defense, benchmark, survey, and tool categories and updated continuously.
Papers are sourced from arXiv, then classified by type and by relevance to real-world AI/ML threats, and cross-referenced with the CVEs and incidents they relate to.
Coverage spans adversarial attacks, model and system defenses, red-teaming benchmarks, literature surveys, and security tooling for LLMs, ML libraries, AI agents, and inference pipelines.
Every paper is filtered for AI security relevance and linked to the vulnerabilities, vendors, and incidents it relates to, so the research connects directly to operational threat intelligence.
Get breaking CVE alerts, compliance reports (ISO 42001, EU AI Act), and CISO risk assessments for your AI/ML stack.
Start 14-Day Free Trial