Deepfakes – hyper realistic and convincing fake videos generated through AI technology – are potentially one of the most disturbing tech developments of recent times. Doctored video footage is nothing new but AI significantly enhances the realism of fake video, enabling unsaid words to be put into an individual’s mouth. From politicians and film stars to CEO and CFOs – the ability to manipulate existing images of public figures, or simply those with sufficient visual online presence, to create fake footage, virtually indistinguishable from the real thing, has far reaching implications. Personal, financial and democratic credibility is at stake. What happens when you can no longer believe your eyes?
The role of artificial intelligence in enabling as well as detecting fakery and fraud was discussed at the recent 22nd International Fraud Group conference. The novelty of Deep Fake video ensures considerable media interest, possibly distorting perceptions of the risk that they pose. Production of the most realistic deep fakes requires substantial financial and technological resource, currently likely only within the reach of larger state actors. However, the technology will inevitably become cheaper and more widely accessible, resulting in highly sophisticated fakes and a marketplace to match. While that day is not here yet, now is the time particularly for public figures to prepare. Critical actions include ensuring a strong narrative underpins their online persona, preferably reinforced by third parties, and having a contingency plan to respond if faked footage does emerge. This places individuals on the front foot in swiftly identifying and contradicting faked footage if it emerges.
More broadly, the defining change that AI brings to the fraudster’s toolkit is an ability to act at scale – to manipulate multiple sources of data, visual or otherwise, quickly and efficiently, creating ever more convincing and complex deceptions to achieve their aims. To combat this requires a collaborative, multidisciplinary response, in which the power of AI can be harnessed to accelerate fraud detection, mitigation and prevention.
While tempting to believe emerging technologies can be the silver bullet, even the most advanced machine learning programme will not be sufficient in isolation. Technology is one of three critical components in fraud detection – managing the human aspect through training, and putting in place robust processes are essential to complement what AI can bring to the table. Organisations should also adopt a holistic top-down approach to fraud – that is, elevate the issue to the board room and ensure an organisation-wide strategy for identifying, preventing and mitigating fraud. To combat increasingly organised and systematic criminals effectively, financial institutions and other organisations need to strategise outside business unit silos.
AI-enabled solutions are, if not a complete answer in themselves, nonetheless reaching an important tipping point in fraud investigations and litigation. Investigators and lawyers increasingly feel able to trust the tech tools at their disposal, enabling them to reach more accurate conclusions more quickly. Predictive coding and cognitive analytics, such as natural language processing (NLP) and sentiment analysis, for example, are two areas where significant advances are being made. Machines can now analyse a mass of documents and determine not only those which are relevant but subsequently detect relevant information and concepts embedded in the text of these documents with 60-70% confidence. The core characteristic underpinning these new technologies is looking at patterns in data to identify the people rather than the act – fraudsters instead of frauds.
So where next? A logical next step, as these tools evolve towards greater precision and accuracy, is to deploy them proactively to detect and stop fraud in its tracks earlier. Wholesale prevention of fraud is likely to be a challenge – fraudsters will inevitably adapt and evolve to evade detection – but earlier mitigation will reduce its financial impact.
