Secure AI Weekly

NIST publishes new guides on AI risk for developers and CISOs CSOOnline, May 1, 2024 The US National Institute of Standards and Technology (NIST) has released four guides aimed at exploring the risks outlined in its influential 2023 “AI Risk Management Framework” (AI RMF). These guides, essential for AI developers ...

How to prevent prompt injection attacks IBM, April 24, 2024 LLMs present a vulnerability: prompt injections, a substantial security flaw for which there seems to be no straightforward solution. Prompt injections involve the infiltration of malicious content disguised as benign user input into an LLM application. By manipulating the system ...

Deploying AI Systems Securely: Best Practices for Deploying Secure and Resilient AI Systems. NSA, April 15, 2024 The National Security Agency (NSA) has unveiled a comprehensive set of recommendations aimed at bolstering the security of AI systems. Released under the title “Strategies for Implementing AI Systems Securely: Effective Measures for ...

Generative AI Security. Theories and Practices Springer, April, 2024 This new book on GenAI security dives into the critical theories and practical approaches necessary to safeguard AI systems, providing actionable insights and essential resources for navigating the complex cybersecurity landscape. It covers strategies and best practices for securing GenAI systems, ...

X’s Grok AI is great – if you want to know how to hot wire a car, make drugs, or worse The Register, April 2, 2024 The innovative generative AI model known as Grok, developed under the helm of Elon Musk’s X, faces a significant challenge: Despite its advanced capabilities, ...

California Releases Generative AI State Procurement Guidelines Government Technology, March 22, 2024 In response to Governor Gavin Newsom’s Executive Order N-12-23, which called for a closer examination of generative AI technologies, new directives have been introduced to fortify the security and safety measures surrounding AI within state agencies and vendor ...

Introducing the Databricks AI Security Framework (DASF) Data Bricks, March 21, 2024 This framework has been meticulously crafted to foster collaboration across various domains including business, IT, data, AI, and security, offering a comprehensive approach towards fortifying AI systems against potential threats. Through demystifying AI and ML concepts, cataloging AI ...

Hackers can read private AI-assistant chats even though they’re encrypted ArsTechnica, March 14, 2024 Despite efforts to encrypt communications, a newly developed attack has demonstrated the ability to decode AI assistant responses with alarming accuracy. Exploiting a side channel present in major AI systems, excluding Google Gemini, this attack compromises ...

Over 100 Malicious AI/ML Models Found on Hugging Face Platform The Hacker News, March 4, 2024 In recent discoveries on the Hugging Face platform, alarming revelations have emerged, with as many as 100 malicious artificial intelligence (AI) and machine learning (ML) models being identified. JFrog, a software supply chain security ...