Architecture Matters: Comparing RAG Systems under Knowledge Base Poisoning
Samuel Korn
Retrieval-Augmented Generation (RAG) systems are vulnerable to knowledge base poisoning, yet existing attacks have been evaluated almost exclusively...
AI Threat Alert indexes 4,319+ peer-reviewed and preprint papers on AI/ML security — covering adversarial attacks, model defenses, red-teaming benchmarks, surveys, and security tooling. Papers are sourced from arXiv, classified by type and by relevance to real-world threats, and cross-referenced with the CVEs and incidents they relate to.
Showing 301–320 of 609 papers
Clear filtersSamuel Korn
Retrieval-Augmented Generation (RAG) systems are vulnerable to knowledge base poisoning, yet existing attacks have been evaluated almost exclusively...
Yiwei Zhang, Jeremiah Birrell, Reza Ebrahimi +3 more
Large language models (LLMs) remain vulnerable to adversarial prompting despite advances in alignment and safety, often exhibiting harmful behaviors...
Marco Rando, Samuel Vaiter
Large language models (LLMs) are known to be vulnerable to jailbreak attacks, which typically rely on carefully designed prompts containing explicit...
Jan Dolejš, Martin Jureček, Róbert Lórencz
Modern malware detection pipelines rely on continuous data ingestion and machine learning to counter the high volume of novel threats. This work...
Jie Zhang, Pura Peetathawatchai, Florian Tramèr +1 more
Vision-language models (VLMs) are increasingly deployed as trusted authorities -- fact-checking images on social media, comparing products, and...
Sarthak Choudhary, Atharv Singh Patlan, Nils Palumbo +3 more
We present Sparse Backdoor, a supply-chain attack that plants a \emph{provably undetectable} backdoor in pre-trained image classifiers, including...
Gabriel Hortea, Juan Tapiador
Malware authors have traditionally relied on polymorphic techniques to produce variants in the same malware family, complicating signature-based...
Gabriel Hortea, Juan Tapiador
Malware authors have traditionally relied on polymorphic techniques to produce variants in the same malware family, complicating signature-based...
Ishrith Gowda
Persistent external memory enables LLM agents to maintain context across sessions, yet its security properties remain formally uncharacterized. We...
Divyam Anshumaan, Sarthak Choudhary, Nils Palumbo +1 more
LLM agents release private data across multi-service interactions. Existing prompt sanitizers based on metric differential privacy treat each release...
Mingshuo Liu, Yiwei Zha, Min Chen
Browsing-enabled LLM assistants can fetch webpages and answer contact-seeking queries, creating a practical channel for scraping contact-style...
Purna Sai Garigipati, Onur Ayan, Kishor Chandra Joshi +1 more
Artificial Intelligence (AI) will play an essential role in 6G. It will fundamentally reshape the network architecture itself and drive major changes...
Wenjing Duan, Qi Zhou, Yuanfan Li
Machine-generated text (MGT) detection is critical for regulating online information ecosystems, yet existing detectors often underperform in...
Wenwei Zhao, Xiaowen Li, Yao Liu +1 more
Federated learning (FL) is vulnerable to poisoning attacks, where malicious clients upload manipulated updates to degrade the performance of the...
Jiajia Li, Xiaoyu Wen, Zhongtian Ma +3 more
The growing capabilities of large language models (LLMs) have driven their widespread deployment across diverse domains, even in potentially...
George Fatouros, Georgios Makridis, John Soldatos +18 more
European financial institutions face mounting regulatory pressure while their security operations centres remain constrained not by data or staffing...
Jona te Lintelo, Lichao Wu, Marina Krček +2 more
Mixture-of-Experts (MoE) architectures in Large Language Models (LLMs) have significantly reduced inference costs through sparse activation. However,...
Han Liu, Shanghao Shi, Yevgeniy Vorobeychik +2 more
Low-Rank Adaptation (LoRA), which leverages the insight that model updates typically reside in a low-dimensional space, has significantly improved...
David Fernandez, Pedram MohajerAnsari, Amir Salarpour +1 more
Vision-language models (VLMs) are increasingly used in autonomous driving because they combine visual perception with language-based reasoning,...
Mahshid Rezakhani, Nowfel Mashnoor, Kimia Azar +1 more
As large language models (LLMs) are increasingly fine-tuned for hardware tasks like RTL code generation, the scarcity of high-quality datasets often...
AI security research studies how AI and machine-learning systems can be attacked and defended — covering adversarial examples, prompt injection, model poisoning, training-data extraction, and the mitigations against them. AI Threat Alert curates this research from academic sources so security teams can track the threats behind emerging AI risks.
AI Threat Alert indexes 4,319+ papers on AI/ML security, classified across attack, defense, benchmark, survey, and tool categories and updated continuously.
Papers are sourced from arXiv, then classified by type and by relevance to real-world AI/ML threats, and cross-referenced with the CVEs and incidents they relate to.
Coverage spans adversarial attacks, model and system defenses, red-teaming benchmarks, literature surveys, and security tooling for LLMs, ML libraries, AI agents, and inference pipelines.
Every paper is filtered for AI security relevance and linked to the vulnerabilities, vendors, and incidents it relates to, so the research connects directly to operational threat intelligence.
Get breaking CVE alerts, compliance reports (ISO 42001, EU AI Act), and CISO risk assessments for your AI/ML stack.
Start 14-Day Free Trial