With the development in artificial intelligence technology in the last few years, the AI face swap has become advanced to the point of seeing extensive and effective use in movies and TV shows, to great effect.
This technology, which utilizes deep learning algorithms to swap faces realistically in videos, has been able to enhance visual effects in movies, but also create new avenues of creative exploration that were not previously possible with conventional digital or practical effects.
So, let’s talk about how these technologies are being used effectively to create and enhance stories in the entertainment world.
Face Swapping in Film Historically
The concept of using a face swap in films believe it or not isn’t something brand new, or even that recent.
Before the advent of artificial intelligence, filmmakers used techniques like prosthetics and technical make-up techniques, and manual digital editing to achieve similar effects to what we call face swapping.
Some very notable examples of early use of ‘face swapping’ using manual techniques in films include Forrest Gump (1994), where real footage of historical events was altered using face swapping to insert the title character into them,
Another example is The Curious Case of Benjamin Button (2008), where techniques similar to face swapping were used to depict the character of Brad Pitt with drastically different physical appearances at various ages.
In the film, The Man in the Iron Mask (1998), Leonardo DiCaprio plays both King Louis XIV and his twin brother Philippe. In scenes where they appear together, a combination of careful editing and body doubles was used to emulate what can be done using face swapping in today’s day and age.
How Modern AI Face Swap Works
Modern AI face swap technology is closely associated with deepfake technology that you might have heard of, they are sometimes also talked about interchangeably.
The process involves training neural networks on large datasets of images and videos of the person’s face, which allows the neural network to learn and understand the minute intricacies of what the person’s face looks like from different angles and how it moves in three-dimensional space.
The process roughly involves three major steps:
- Data Collection: High-quality image and video footage of the actors in a diverse range of environments and angles are collected and fed to the training algorithm.
- Model Training: An AI algorithm capable of learning and independent decision-making is trained using the input data to be able to understand the faces of the actors. They are then able to replicate these facial features and natural movement patterns on a target face.
- Implementation: The trained model is then used to swap a target actor or individual’s face with that of the intended actor. This output is often subsequently processed to adjust for better lighting, blending, and more to make it seem much more realistic and make the effect more convincing.
Notable Examples of AI Face Swapping
Now, let’s talk about some examples of how modern face swap technology has been effectively used creatively in films to achieve a better effect than ever before.
The Irishman (2019)
Possibly the most popular example of the use of facial manipulation in a recent film would probably be the Netflix film The Irishman which came out in 2019.
In this film made by Martin Scorsese, the major actors including Robert De Niro, Al Pacino, and Joe Pesci are made to look much younger than they actually are. This was achieved using a combination of AI face swapping and CGI techniques, to create what is thought to be one of the most effective and convincing examples of digital de-aging that has been seen in the film industry thus far.
Rogue One: A Star Wars Story (2016)
In this film, AI technology was used to recreate the likeness of late actor Peter Cushing in the role of Grand Moff Tarkin, by swapping his face from old footage onto the face of a living actor playing his role in the film.
This is one of the better-known and more convincing, but not the only example of bringing actors who have passed away back to life in this very film, and what’s more, younger than they were at the time of their death. Popular actress Carrie Fisher who played Leia Organa was also brought back to life using the same technology, but less convincingly.
Gemini Man (2019)
This technology was also effectively used to create a younger version of actor Will Smith for Gemini Man. And what’s more, the tech was also used to implant this younger face onto a different actor so that Will Smith could act alongside him in the scenes of the film.
Conclusion
Modern AI face swap technology has found effective use in the Hollywood film and television industry, creating new avenues for creative expression and depiction in films, like Rogue One, Gemini Man, and The Irishmen in recent years.
