Secure AI Weekly

Comply or Die: The Rise of the AI Governance Stack Battery Ventures, September 13, 2023 While regulatory efforts are catching up, with the European Union leading the way and localized efforts in the United States filling the federal void, there is still much work to be done. As the race ...

Tackling Trust, Risk and Security in AI Models Gartner, September 5, 2023 The surge of interest in generative AI technologies has led to a plethora of pilot projects, but what often falls by the wayside is a robust risk assessment. Organizations frequently don’t consider safety and security implications until their ...

UK cybersecurity agency warns of chatbot ‘prompt injection’ attacks The Guardian, August 30, 2023 The United Kingdom’s National Cyber Security Centre (NCSC) has recently raised alarms about the escalating cybersecurity threats surrounding chatbots. These automated conversational agents, powered by large language models (LLMs) like OpenAI’s ChatGPT and Google’s Bard, are ...

Tricks for making AI chatbots break rules are freely available online NewScientist, August 21, 2023 Artificial intelligence chatbots like ChatGPT have become essential tools for various online activities, but their security loopholes present an emerging concern. Manipulative text prompts, often referred to as “jailbreak prompts,” can mislead these AI systems ...

Don’t expect quick fixes in ‘red-teaming’ of AI models. Security was an afterthought APNews, August 14, 2023 The recent DefCon hacker conference in Las Vegas served as a stark reminder of the pressing concerns around AI safety and security. The event saw 2,200 participants rigorously testing eight advanced language models, ...

Meet the hackers who are trying to make AI go rogue Washington Post, August 8, 2023 With the White House’s endorsement, the Generative Red Team Challenge aims to rigorously assess the reliability of AI. This includes examining the potential for political misinformation, inherent biases, and even defamatory outputs. Companies like ...

The generative A.I. battle between companies and hackers is starting CNBC, August 2, 2023 Last month, tech titans like Amazon, Google, Meta, and Microsoft collaborated with President Joe Biden, emphasizing their commitment to ensure that AI technologies undergo rigorous safety checks before public deployment. The primary concern is the role ...

ChatGPT Has a Plugin Problem Wired, July 25, 2023 Over the past eight months, OpenAI’s ChatGPT has dazzled millions with its ability to produce lifelike text, from stories to code. However, the development and rapid proliferation of plugins to extend ChatGPT’s capabilities have raised serious security concerns. The introduction of ...

FACT SHEET: Biden-⁠Harris Administration Secures Voluntary Commitments from Leading Artificial Intelligence Companies to Manage the Risks Posed by AI White House, July 21, 2023 The Biden-Harris Administration has underscored its commitment to harness the transformative potential of Artificial Intelligence (AI), while simultaneously ensuring its responsible and secure use. Taking decisive ...