Google shares how all the world’s baddies have been using Gemini for their nefarious deeds

It turns out that AI tools for making your job easier can also make it easier for bad guys to do theirs.

Feb 1, 2025 - 00:45
 0
Google shares how all the world’s baddies have been using Gemini for their nefarious deeds
  • Gemini is built with safeguards to prevent misuse, but that doesn’t stop some government-funded bad guys from trying to use it to cause harm.
  • Advanced Persistent Threat groups from China, Iran, North Korea, and Russia have all been identified as getting help from Gemini.
  • The most common uses of Gemini appear to be for researching targets and helping at coding.

From pretty much the moment that powerful AI language models debuted on the scene, bad guys have been looking to do bad stuff with them. The companies behind them make concerted efforts to protect their models with safeguards against abuse, but bad actors are always coming up with new ways to try and get around these barriers. This week Google shares what it’s observed when it comes to Gemini and some well-connected international groups trying to use it for nasty business.

Google’s Threat Intelligence Group just published its report on adversarial misuse of generative AI. For starters, the company identifies two main types of attacks: those that use AI to lend a hand, like generating code that might be used to build malware, and those that directly try to get AI to perform unwanted actions, like harvesting account data. We also hear about two primary categories of adversaries: Advanced Persistent Threats (APT), which tend to be big nation-state-funded hacker groups, and Information Operations (IO), which are more about deception and making a mess of social media.