ETFOptimize | High-performance ETF-based Investment Strategies

Quantitative strategies, Wall Street-caliber research, and insightful market analysis since 1998.


ETFOptimize | HOME
Close Window

Generative AI tools lead to rising deepfake fraud

The increasing sophistication of generative AI platforms has led to an uptick in the use of AI-generated deepfakes by fraudsters that are harder for verification systems to detect.

As the rise of generative artificial intelligence (AI) technologies has created new opportunities for businesses and individuals looking to leverage those new tools, it has also opened the door to the misuse of those technologies by fraudsters looking to use deepfakes and other methods to carry out crimes.

Some data indicate that the use of AI-generated deepfakes to commit crimes is on the rise. Sumsub – a company that offers know-your-customer (KYC), know-your-business (KYB), transaction monitoring and anti-money laundering solutions – released data Monday showing an uptick in deepfake fraud over the last year. Deepfakes use biometric data to produce counterfeit images and audio that appear realistic to an unwitting viewer or listener.

Pavel Goldman-Kalaydin, the head of artificial intelligence and machine learning at Sumsub, explained the linkage between the growing sophistication and availability of generative AI tools and the use of deepfakes to FOX Business

"It’s not a coincidence but rather a logical consequence. With the growing trend of generative AI tools and image deepfake usage, it is evident that deepfakes have become more prevalent in recent months. In fact, we have seen more deepfakes in the past three months than we have seen in the past few years."

FTC ISSUES WARNING ON MISUSE OF BIOMETRIC INFO AMID RISE OF GENERATIVE AI

Sumsub’s report on fraud statistics released Tuesday found that the proportion of fraud cases involving the use of deepfakes jumped from 0.2% in Q1 2022 to 2.6% in Q1 2023 for the U.S., and from 0.1% to 4.6% in Canada over the same period. Goldman-Kalaydin said that the evolution of generative AI platforms has made it easier for fraudsters to create deepfakes capable of thwarting antifraud safeguards.

"Recent advances in image generation have also influenced the generation of deepfakes. A typical scenario a year ago was to use a real stolen document as a base, and then use a face swap of the face from the document to a prerecorded video of a fraudster. This allowed the fraudster to move their head as required by many verification platforms," he explained. 

"Now, it is not always necessary to have such a source face image. Instead, you can generate from scratch and use it in both documents and face photos. This makes it harder for verification platforms to search for stolen identities because there is nothing to search for."

WHAT ARE THE DANGERS OF AI? FIND OUT WHY PEOPLE ARE AFRAID OF ARTIFICIAL INTELLIGENCE

In terms of which industries are at the greatest risk of deepfake fraud, Goldman-Kalaydin said that fintech, cryptocurrency and gambling platforms are "especially at risk" but that "all businesses operating digitally and performing remote verification are vulnerable to deepfake fraud."

Goldman-Kalaydin noted that, "As generative AI technology advances, more tools become available to fraudsters." He went on to explain that he and the Sumsub team have encountered fraudsters whose use of AI tools generally falls into two categories of sophistication:

"There are two types of fraudsters: very tech-savvy teams that use the most advanced tech and hardware, such as high-end GPUs (graphic processing units) and state-of-the-art generative AI models, and lower-level fraudsters who use commonly available tools on computers. For example, there are people who have been banned from gambling sites for rules violations who want to return to the site by any means."

GET FOX BUSINESS ON THE GO BY CLICKING HERE

As for what consumers and members of the general public can do to prevent the use of their data to create a deepfake, Goldman-Salaydin said that verification platforms considering multiple factors may be the best means of deterring deepfake fraud.

"Answering this question is not easy. While posting high-quality face images on social networks is not recommended, even low-quality images can be used to create deepfakes that can then be enhanced with superresolution techniques to make them look realistic," he said. "Ultimately, one can only hope that verification platforms employ multiple checks, not just on the image itself, but also on the user’s behavior to detect and prevent fraud."

Stock Quote API & Stock News API supplied by www.cloudquote.io
Quotes delayed at least 20 minutes.
By accessing this page, you agree to the following
Privacy Policy and Terms Of Service.


 

IntelligentValue Home
Close Window

DISCLAIMER

All content herein is issued solely for informational purposes and is not to be construed as an offer to sell or the solicitation of an offer to buy, nor should it be interpreted as a recommendation to buy, hold or sell (short or otherwise) any security.  All opinions, analyses, and information included herein are based on sources believed to be reliable, but no representation or warranty of any kind, expressed or implied, is made including but not limited to any representation or warranty concerning accuracy, completeness, correctness, timeliness or appropriateness. We undertake no obligation to update such opinions, analysis or information. You should independently verify all information contained on this website. Some information is based on analysis of past performance or hypothetical performance results, which have inherent limitations. We make no representation that any particular equity or strategy will or is likely to achieve profits or losses similar to those shown. Shareholders, employees, writers, contractors, and affiliates associated with ETFOptimize.com may have ownership positions in the securities that are mentioned. If you are not sure if ETFs, algorithmic investing, or a particular investment is right for you, you are urged to consult with a Registered Investment Advisor (RIA). Neither this website nor anyone associated with producing its content are Registered Investment Advisors, and no attempt is made herein to substitute for personalized, professional investment advice. Neither ETFOptimize.com, Global Alpha Investments, Inc., nor its employees, service providers, associates, or affiliates are responsible for any investment losses you may incur as a result of using the information provided herein. Remember that past investment returns may not be indicative of future returns.

Copyright © 1998-2017 ETFOptimize.com, a publication of Optimized Investments, Inc. All rights reserved.