Deepfake fraud, artificial identities, and AI-powered scams make id theft tougher to detect and forestall – here is struggle again
11 Feb 2025
•
,
4 min. learn

Synthetic intelligence (AI) is remodeling our world in methods each anticipated and unexpected. For customers, the expertise means extra precisely personalised digital content material, higher healthcare diagnostics, real-time language translation to assist on vacation, and generative AI assistants to boost productiveness at work. However AI can be used to assist cybercriminals be extra productive, particularly with regards to id fraud – essentially the most widespread fraud kind in the present day.
Over a 3rd of banking danger and innovation leaders within the UK, Spain and US cite their largest problem in the present day because the rise of AI-generated fraud and deepfakes, making it the primary reply. So how does AI-powered fraud work and what are you able to do to remain secure?
How does AI-driven id fraud work?
Identification fraud refers to using your personally identifiable info (PII) to commit against the law, similar to operating up bank card debt in your identify, or accessing a financial institution or different account. Based on one estimate, AI-driven fraud now accounts for over two-fifths (43%) of all fraud makes an attempt recorded by the monetary and funds sector. Almost a 3rd (29%) of these makes an attempt are thought to achieve success. So how is AI serving to the cybercriminals?
There are a number of totally different ways we are able to spotlight:
- Deepfake account takeovers (ATOs) and account creation: Scammers are utilizing deepfake audio and video likenesses of official customers to bypass the Know Your Buyer (KYC) checks utilized by monetary companies firms to confirm clients are who they are saying they’re. A picture or video of you is scraped from the net and fed right into a deepfake software or generative AI. It’s then inserted into the information stream between consumer and repair supplier in so-called injection assaults designed to idiot the authentication methods. One report claims that deepfakes now account for 1 / 4 (24%) of fraudulent makes an attempt to cross motion-based biometrics checks and 5% of static selfie-based checks.
- Doc forgeries: There was a time when fraudsters used bodily doc forgeries, similar to faked passport pages, to open new accounts within the names of unassuming victims. Nonetheless, they’re extra probably in the present day to take action digitally. Based on this report, digital forgeries account for over 57% of all doc fraud – a 244% annual enhance. Scammers will sometimes entry doc templates on-line or obtain doc photos stolen in information breaches after which alter the small print in Photoshop. Generative AI (GenAI) instruments are serving to them to do that at velocity and scale.
- Artificial fraud: That is the place scammers both create new identities by combining actual (stolen) and made-up PII to kind a very new (artificial) id, or create a brand new id utilizing simply fabricated information. That is then used to open new accounts with banks and bank card companies, for instance. Doc forgeries and deepfakes might be mixed with these identities to extend the fraudsters’ possibilities of success. Based on one report, 76% of US fraud and danger professionals suppose their group has artificial clients. They estimate that the sort of fraud has surged 17% yearly.
- Deepfakes that trick family and friends: Typically, faux video or audio can be utilized in scams that trick even family members. One tactic is digital kidnapping, the place family obtain a cellphone name from a menace actor claiming to have kidnapped you. They play a deepfake audio of your voice for proof after which demand a ransom. GenAI can even utilized in these efforts to assist the scammers supply a probable sufferer. ESET World Safety Advisor Jake Moore gave a style of what’s at the moment doable right here and right here.
- Credential stuffing (for ATO): Credential stuffing includes using stolen log-ins in automated makes an attempt to entry different accounts for which you might have used the identical username and password. AI-powered instruments may quickly generate these credential lists from a number of sources of information, serving to to scale assaults. They usually may be used to precisely mimic human habits whereas logging in, as a way to trick defensive filters.
What’s the affect of AI-based fraud?
Fraud is way from a victimless crime. Actually, AI-powered fraud can:
- Trigger main emotional misery for the person who’s defrauded. One report claims that 16% of victims contemplated suicide because of an id crime
- Make scams extra more likely to succeed, consuming into earnings, which forces firms to place their costs up for everybody
- Affect the nationwide financial system. Decrease earnings imply decrease tax receipts, which in flip imply much less money to spend on public companies
- Undermine public confidence within the rule of legislation and even democracy
- Undermine enterprise confidence, probably resulting in decrease ranges of funding into the nation
The best way to hold your id secure from AI-driven fraud
To fight the offensive use of AI in opposition to them, organizations are more and more turning to defensive AI instruments to identify the tell-tale indicators of fraud. However what are you able to do? Maybe the simplest technique is to reduce alternatives for menace actors to acquire your PII and audio/video information within the first place. Meaning:
- Don’t overshare info on social media and prohibit your privateness settings
- Be phishing conscious: examine sender domains, search for typos and grammatical errors, and by no means click on on hyperlinks or open attachments in unsolicited emails
- Activate multifactor-authentication (MFA) on all accounts
- At all times use robust, distinctive passwords saved in a password supervisor
- Preserve software program updated on all laptops and cellular gadgets
- Holding an in depth eye on financial institution and card accounts, commonly checking for suspicious exercise and freezing accounts instantly if one thing doesn’t look proper
- Set up multi-layered safety software program from a good vendor on all gadgets
Additionally contemplate staying conscious of the newest AI-powered fraud ways and educating family and friends about deepfakes and AI fraud.
AI-driven fraud assaults will solely proceed to develop because the expertise will get cheaper and simpler. As this new cyber-arms race performs out between company community defenders and their adversaries, it’s customers that shall be caught within the center. Be sure you’re not subsequent.