Trusted AI Blog

It’s Surprisingly Easy to Jailbreak LLM-Driven Robots Researchers induced bots to ignore their safeguards without exception IEEE Spectrum, November 11, 2024 The rapid integration of large language models (LLMs) like ChatGPT into robotics has revolutionized how robots interact with humans, offering capabilities such as voice-activated commands and task execution based ...

Microsoft’s Yonatan Zunger on Red Teaming Generative AI The Cyber Wire, November 6, 2024 In a recent Microsoft Threat Intelligence Podcast episode, host Sherrod DeGrippo speaks with Yonatan Zunger, Corporate Vice President of AI Safety and Security at Microsoft, to explore the critical importance of securing AI systems. The conversation ...

Researchers Uncover Vulnerabilities in Open-Source AI and ML Models The Hacker News, October 29, 2024 Recent disclosures have highlighted over thirty security vulnerabilities within various open-source artificial intelligence (AI) and machine learning (ML) models, some of which could allow for remote code execution and unauthorized data access. Key flaws have ...

SAIF Risk Assessment: A new tool to help secure AI systems across industry Google Blog, October 24, 2024 In recent years, the Secure AI Framework (SAIF) was developed to promote the safe and responsible deployment of AI models. Designed to support developers and security professionals, SAIF provides best practices and ...

LLMs are easier to jailbreak using keywords from marginalized groups, study finds The Decoder, October 20, 2024 A recent study highlights unintended vulnerabilities in the safety protocols of large language models (LLMs), revealing that well-meaning ethical measures can introduce security gaps. Researchers found that the ease with which these models ...

How to enable secure use of AI The Register, October 10, 2024 The UK National Cyber Security Centre (NCSC) highlights several areas where AI can be exploited, but organizations need practical solutions that enable them to adopt AI safely and responsibly. This is where the SANS AI Toolkit comes in, ...

California Governor Vetoes AI Regulation Bill, Calls for More Targeted Approach Campus Technology, September 30, 2024 California Governor Gavin Newsom has vetoed Senate Bill 1047, a proposed law designed to regulate AI and prevent its misuse. The bill, which had received strong legislative support, aimed to establish some of the ...

AI ‘godfather’ says OpenAI’s new model may be able to deceive and needs ‘much stronger safety tests’ Business Insider, September, 2024 Yoshua Bengio, the “Godfather of AI,” raises concerns about OpenAI’s new O1 model, warning it could deceive users and pose significant risks if not properly controlled. He advocates for ...

Security leaders warn of new risks as AI drives code development in 83% of organisations Tech Monitor, September 18, 2024 The study found that 83% of organizations are now using AI to generate code, but 92% of cybersecurity leaders worry about the potential risks associated with this technology. The pace ...