Secure AI Weekly

AI ‘godfather’ says OpenAI’s new model may be able to deceive and needs ‘much stronger safety tests’ Business Insider, September, 2024 Yoshua Bengio, the “Godfather of AI,” raises concerns about OpenAI’s new O1 model, warning it could deceive users and pose significant risks if not properly controlled. He advocates for ...

Security leaders warn of new risks as AI drives code development in 83% of organisations Tech Monitor, September 18, 2024 The study found that 83% of organizations are now using AI to generate code, but 92% of cybersecurity leaders worry about the potential risks associated with this technology. The pace ...

Governance framework promotes AI security China Daily, September 11, 2024 A new governance framework aimed at enhancing the security and safety of AI was introduced during China Cybersecurity Week in Guangzhou, Guangdong province. Announced by the National Technical Committee 260 on Cybersecurity of the Standardization Administration of China, the framework ...

Top five strategies from Meta’s CyberSecEval 3 to combat weaponized LLMs Venture Beat, September 3, 2024 Meta’s CyberSecEval 3 framework highlights the urgent need for comprehensive security measures as AI technologies, particularly large language models (LLMs), become more prevalent. The framework suggests five key strategies for safeguarding AI systems. These ...

Hundreds of LLM Servers Expose Corporate, Health & Other Online Data DarkReading, August 28, 2024 Recent discoveries have highlighted a troubling issue: hundreds of LLM servers are inadvertently exposing sensitive corporate, healthcare, and personal data online due to misconfigurations and insufficient security measures.  These servers, often left unprotected by adequate ...

Securing LLM Backed Systems: Essential Authorization Practices Cloud Security Alliance, August 13, 2024 The widespread use of LLMs, while offering significant benefits, also introduces substantial security risks, particularly concerning unauthorized data access and potential model exploitation. To address these concerns, the Cloud Security Alliance (CSA) has provided essential guidelines for ...

Jailbreaking LLMs and abusing Copilot to “live off the land” of M365 The Stack, August 9, 2024 As artificial intelligence (AI) systems like large language models (LLMs) and AI-driven tools such as GitHub’s Copilot become more embedded in our digital environments, they also introduce significant security risks. Recent research has ...

The search for a new way to report AI model flaws Axios, August 6, 2024 AI security experts are convening in Las Vegas this week to tackle a critical challenge: establishing effective methods for reporting security vulnerabilities in AI models. Currently, there is no standardized process for ethical hackers to ...

Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile NIST, July 26, 2024 The National Institute of Standards and Technology (NIST) has released the “Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile,” a companion to the AI Risk Management Framework (AI RMF 1.0). This framework is designed to help ...