[DEEPFAKE] ROGUE ONE: MOFF TARKIN - IMPROVED AGAIN!
Vložit
- čas přidán 3. 12. 2020
- Seven months after I uploaded my attempt to "fix" the look of Moff Tarkin in Rogue One, I am back with another video trying to apply everything I have learned in these seven months. I am aware that applying deepfake to a CGI animation is not the best approach for this project but I have not been able to access Guy Henry's CGI-free footage. I hope you enjoy it.
Many thanks to my Patreon supporters for helping me to support this channel.
Please consider supporting this channel on:
/ jarkan or www.paypal.me/JarkanYT
Thanks for watching!
Tool used:
Deepfake: github.com/iperov/DeepFaceLab
Twitter: / jarkancio
Email: Jarkancio@gmail.com
#Rogue One #deepfake - Krátké a kreslené filmy
The eyes look alive now.
Never understood why they didn't keep Guy Henry's eyes!
It looks better and it is very impressive, but it is still not quite there
Christ, you actually raised this man from the dead.
@Jaeger19Ultima Are you kidding? The only difference is the lines. I've compared Guy Henry's impression and Cushing himself. They're pretty much identical.
@@GROENAASMusic He sounds like he’s doing a very bad impersonation of Peter Cushing and not good enough.
Meh... the movement is still off-putting.
I think the weirdest thing-in both versions-is seeing Cushing onscreen, but with more modern-styled cinematography, direction, and lighting.
I remember seeing that for the first time and cringed in the theater. It was really unsettling but also very impressive at the same time. It’s amazing how just a few years later it already looks dated and bad
@@guyswithnothingtodo it looked dated then since without deepfake, we're just not there yet. Put CG characters next to CG characters and it's fine, but next to real humans for now it always looks fake.
@@DOSkywalkR if there were only CG people it would still look kind of uncanny, but seeing CG Cushing next to real actors definetly makes his face's fakeness more apparent.
@@ginogatash4030 yeah, I didn't say "put him next to CG characters and he looks real", what I meant was the human eye gets used to CG characters when all of them are CG (or when they look different enough from humans it's ok to put them next to one like in Avatar or so).
@@DOSkywalkR yeah, I was just adding to your argument
I thought it looked "ok", until you showed the side by side. You just added a huge step up
This is nearly perfect. It didn’t look cg to me anymore. Looked like the same living breathing actor from A New Hope returning to the role.
I swear people are being a bit too choosy now. This is near Perfection.
The shape looks better. The shadows and highlights don't write match the people around. Better than the original film though!
And he's not as shiny.
I feel like you with a Disney budget could achieve some great things in the realm of Star Wars effects
I don't think so.... You realize he used the original footage ... From the movie
The face does look way better but the animated character still looks unnaturally stable and robotic compared to the real actors. Not much can be done about that I think.
Well, it's not due to a problem of the actor himself. The actor that played this Tarkin was present, looked quite similar, but, I think what causes the unnatural stability is just how the face is done, and maybe how the actor moved. He may have been told to move in a way that was a bit too stilted, but for a first attempt, I think they got it more right than wrong, but still in the uncanny valley. With the touch up, it does look far better.
@@Stargun-vj1uh Yeah, I wonder if they told him to keep his face relatively still to make the sfx job relatively simple.
The body is actualy an actor
That would be because motion capture isn't sophisticated enough to be used raw - a large part of the cleanup process is smoothing, which gets rid of many of the smaller movements alongside the tracking jitter.
@@gentlebabarian the lips not the body
Beautiful! Gone is the dead, waxy look! I am shocked that Lucas doesn't go back and re-do it like this!
Cause Lucas no longer runs Lucasfilm.
The shadows and lighting were so off with the Original.
You nailed it.
I agree if I was Disney I would’ve given this guy the original footage with the original actor to use as reference points but he did an amazing job
Are you saved? If you died tonight will you go to heaven or will you go to hell?
Acts 16:30-31 KJV
...what must I do to be saved? And they said, Believe on the Lord Jesus Christ, and thou shalt be saved, and thy house.
God Almighty, the Creator was manifest in the flesh. He came into the world to take away the sin of the world. He gave up his own life to save yours. His sacrifice on the cross paid the price for your redemption with his own blood. On the third day he rose from dead and offers the gift of salvation and forgiveness to those that repent and trust in him.
This is the Gospel which means the Good News. Turn to Christ and live.
John 1:1,14 KJV
In the beginning was the Word, and the Word was with God, and the Word was God. [14] And the Word was made flesh, and dwelt among us,
Isaiah 9:6 KJV
For unto us a child is born, unto us a son is given: and the government shall be upon his shoulder: and his name shall be called Wonderful, Counsellor, The mighty God, The everlasting Father, The Prince of Peace.
John 1:10 KJV
He was in the world, and the world was made by him, and the world knew him not.
John 20:28-29 KJV
And Thomas answered and said unto him, My Lord and my God. [29] Jesus saith unto him, Thomas, because thou hast seen me, thou hast believed: blessed are they that have not seen, and yet have believed.
czcams.com/video/14y_VIJ2ZbM/video.html
@@jesusisgod2953 im saved
@@jesusisgod2953 Okay...What does the Bible have to do with a deepfake video? No offence, but, there's a time and place for everything, and this isn't the place for talking about religion, you know? Wouldn't it be better to talk about that stuff on a video that's about religion? Just saying is all
@@XephThePanda
Mark 16:15-16 KJV
And he said unto them, Go ye into all the world, and PREACH THE GOSPEL to every creature. [16] He that believeth and is baptized shall be saved; but HE THAT BELIEVETH NOT SHALL BE DAMNED.
John 3:18 KJV
He that believeth on him is not condemned: but HE THAT BELIEVETH NOT IS CONDEMNED ALREADY, because he hath not believed in the name of the only begotten Son of God.
The original looked damn good and I had chills in the theatres....but if I saw your version in 2016 then I would have been floored! The lighting and touches you've added have brought Peter Cushing out of the shadows....
Seriously you have raised Peter Cushing from the dead, Perfection!!
Absolutely fantastic!
The biggest problem with Tarkin in Rogue One, and something that no one has pointed out, is the fact that Guy Henry is way taller than Cushing. His body type is different as well. So it's not just the weird CGI animation, it's also the fact that this Tarkin doesn't look consistent with the one in Star Wars.
Great job on the deepfake though, I also noticed you brought the pink back in their skin, which helps sell the 'realism'.
Wow! Would it be possible to get a high res version so I can add it to my Rogue One Edit when it's done?
Amazing work! Absolutely amazing.
whats it gonna be called
@@kennethnorth7018 haven't got that far yet. Still working on the sequels.
Where can I follow this project??
@@dustinakadustin click my name
I wanted the same thing, I would like to see ROGUE ONE and the end of The Mandalorian without feeling that uncanny valley.
Hasn't he answered you?
Youve given the character nuancical wrinkles and dimples and micro-expressions that have made the face far more human. The difference is phenomenal. Excellent work.
On the flipside, we are all about to enter a whole new phase in The Age of Fraud.
Much better. You fixed his eyes. Now at least they are looking at each other. Bravo
I don’t understand why this isn’t utilized more in movies. It would be way cheaper to do and looks way better. Is this technology not for sale or something?
The technology isn't for sale - it's free. The problem with deepfakes is a) they're difficult to control - you never quite know what the neural net will plop out - and b) while they are good in aggregate (major facial features, contours, etc) they are bad in the details; the skin loses detail and gets smoothed out. You can easily see it even in this clip. That looks fine on a small display watching CZcams, not so much in the cinema on a giant screen. I'm sure ways of fixing both those flaws are being investigated though.
@@KillahMate I agree with your last statement, they can easily do a deepfake, and easy fix whatever small flaws seem to pop out here and there (would be much cheaper than doing it the normal way IMO)
@@KillahMate I’ve never used or created a deep fake but from what I understand I thought the ‘smoothing’ was a time problem, given more time and detailed reference for the ai to learn from it gets better, or is there an upper limit?
@@Doiknowyou566 there isn't an upper limit theoretically - but it's both a time and complexity problem. Recreating more detail requires both more video for analysis as you say, and also a more complex neural net (and therefore more processing power) the more precise you want it to be. A less advanced model will never recreate very fine detail regardless of how much video it's fed. And a more complex net isn't strictly a matter of more power, usually a real jump in quality requires a whole new neural net design (like what the move to GANs was), which of course somebody has to invent first.
@@KillahMate Thanks for taking the time to explain.
You make difficult cgi look easy, keep up the good work !
This version is the best so far! I think the structure of his his actual face really helps the deepfake, though the poor mouth animations hold it back. In future the ideal setup would be to makeup the actor with prosthetics to look as close to the deepfake actor as possible. Then it will look more natural.
You should overlay this with the original and set the layer transfer mode to "difference". It would show exactly what the deep fake targeted.
@Adam Haywood Subtract, divide, or exclusion then? It's definitely a cancellation operation.
@@SaltyViper Ignore him, he's stupid. Difference would work fine.
Flabbergasting how the improvements have been done - it’s a credit to Cushing
Brilliant job, mate! I can't imagine how long it took to get these results! It looks infinitely better than the movie does... so, maybe, Disney should've hired you? Hopefully your work reaches a bigger audience, because this is great!
Truly excellent work!! Well done!
I’d buy this version if you sold it
Yes, this looks way better than ypur first attempt.
Very well done. 😊
The best. Jarkan to ILM. 👏🏼👏🏼👏🏼👏🏼
We need a version of the movie including this stunning fix!!
I would love to see a Sebastian Stan as Luke Skywalker
Especially as ROTJ Luke! Maybe another montage of Sebastian in the trilogy like what Jarkan did for Tarkin? Hey, that rhymes!
Well Luke DID come back, but it wasn’t Sebastian Stan however.
You NAILED it. The key is the eyes and skin texture.
This is the perfect fix!! More natural and realistic than ever! There are 2 another problems with -TARKIN CGI in Rogue One:
No accurancy of Tarkin's Hair with ANH footage.
-Stature of both actors don't seem the same, in Rogue One Tarkin looks taller than ANH.
Hopefully Disney could edit the film and fix Tarkin and Leia CGI wirth deepfake and other details with CGI.
WOW! the features look so much better! The colouring in his face is much more like the original trilogy Tarkin as well
This is perfect. Espc the rubbery mouth movements from before are fixed. You should be hired by a major studio, im serious.
You did a great job on this. Wow.
THIS IS GOING IN MY EDIT OF RISE OF THE REBELION THNK YOU
Wow, when Tarkin turns his head at 0:39, he looks real. Awesome job!
Superb work. It now looks like Peter Cushing was actually there. Well done.
You just nailed it! Awesome! Far better than the original!
Magnificent 😮😶🙃💛
I find this brilliant
Nailed the lighting. You fixed the unnatural feeling for sure this time. I think that's is one mistake with deep fakes is the lighting and color. You killed it!!!
The fact this is so well done supports what some others have said. It’s the body motions that are off, not the ‘look’.
You have succeeded to bring him to live. It is all in the eyes. Wish someone would redo these scenes in the full film.
Beautiful! Job well done!
Yeah this is a lot less uncanny and doesn't feel out of place anymore, nice job
Impressive. Most impressive. Makes it more natural looking.
These are amazing you did a phenomenal job! If you’re ever looking for another idea, I recommend doing doc brown from back to the future. Since 4K format has shown all the bad make up affects for aging. Deep faking his face with his actual face what he look like in 2015 would be perfect. Another one in that same movie would be Biff and Marty McFly in Part 2. I know all these actors were really filmed well during that time and you’d have a lot of data footage to work with.
Now what I really want to know is: How can we get this fantastic piece of work into a full cut of the movie? I can never bring myself to watch Rogue One with it's original and inferior Tarkin (and Leia) scenes again knowing that better ones exist!
Upper lip and eyes still in the uncanny valley
Now I'm not jarred out of the story. As Yoda says, "Do or do not. There is no try." Applause, my friend. Now you need to put Christopher Reeve in Superman Returns, with Margot Kidder inside the helicopter scene. That's the first one. Second one is Gene Hackman and Christopher Reeve chatting on the new continent filled with Kryptonite where Lex shoves Superman down the stairs.
I guess we still can’t get rid of the uncanny valley, but damn, this looks much better. This one even lacks the dead eyes that deep fakes like this usually have.
Grandisimo trabajo. Parece el Tarkin real de Una Nueva Esperanza
You can't complain about this. It's pretty much perfect.
Do Sebastian Stan as Luke Skywalker!
Do Anakin as Sebastian Stan! Could easily pass for Luke's father
@@matthewoates Luke first.
Why world you want to replace Luke with someone who looks a bit like Luke? There's no substitute for Mark Hamill in any case 😅
Anakin needs some work though to make him look more like Luke's Dad 🙂 it'd be great to see Sebastian in place of Hayden (No offence Hayden)
Are you saved? If you died tonight will you go to heaven or will you go to hell?
Acts 16:30-31 KJV
...what must I do to be saved? And they said, Believe on the Lord Jesus Christ, and thou shalt be saved, and thy house.
God Almighty, the Creator was manifest in the flesh. He came into the world to take away the sin of the world. He gave up his own life to save yours. His sacrifice on the cross paid the price for your redemption with his own blood. On the third day he rose from dead and offers the gift of salvation and forgiveness to those that repent and trust in him.
This is the Gospel which means the Good News. Turn to Christ and live.
John 1:1,14 KJV
In the beginning was the Word, and the Word was with God, and the Word was God. [14] And the Word was made flesh, and dwelt among us,
Isaiah 9:6 KJV
For unto us a child is born, unto us a son is given: and the government shall be upon his shoulder: and his name shall be called Wonderful, Counsellor, The mighty God, The everlasting Father, The Prince of Peace.
John 1:10 KJV
He was in the world, and the world was made by him, and the world knew him not.
John 20:28-29 KJV
And Thomas answered and said unto him, My Lord and my God. [29] Jesus saith unto him, Thomas, because thou hast seen me, thou hast believed: blessed are they that have not seen, and yet have believed.
czcams.com/video/14y_VIJ2ZbM/video.html
@@matthewoates That's the point. Stan looks like Luke. And a lot of fans want to see him play the role, including Mark Hamill himself.
Wow this is really good😮
Wow you made this movie awesome you made the interaction spot on.
There is still an uncanny valley feel because of the animation.
And your work is big improvement on the original, even atop the CGI animation.
WOW!!! Good job!
Yes this is the ultimate update. I believe it was all about skin texture. Some of his corporal movements are little bit weird but I believe because of motion capture. Anyways, I never complained from any of this CGI and the ones from movies and Mandalorian because it is a way to tell us: “we know the story and we know we need this specific character at this specific part of the line”
it certainly isn't perfect, especially up close, but this is MUCH better than the movies! Incredible!
Amazing work
That was a perfect fix. Perfect.
The only problem of using deepfakes over (or I should say above) CGI Footage is that it also uses the horrible CGI captured face motion, but yes, this looks WAY BETTER than the CGI face.
Thank you, I hope they fix this and release it again. I don’t know why a major corporation like Disney couldn’t get this simple thing right. If you’re going to bring him back do it right. It’s the only thing about the movie that didn’t work.
Ok Georges has to re do EVERYTHING AGAIN now
Why is your video not removed due 'Content ID' policy from Disney?
I'm trying to upload star wars videos aswel but they all got blocked in all countries :(
Personally, I think both look absolutely magical. I'm enthralled by both.
Sweet Caroline, this looks good!
That is amazing
This looks much better than the theatrical version
This looks much better! I still kind of wish they had just put Guy Henry in makeup to look more like Cushing instead of using CG. It worked with Mon Mothma, and I think Henry looks enough like Cushing for it to be close enough. The original scene took me out of the movie because of the extreme uncanny valley effect.
Coming from someone who knows nothing of the technicalities of computer generated imagery:
That wrinkle in his eyebrow on the right makes the extra difference. Makes him look more skeptical with Orson. In some shots, the one on the left looks a bit better due to facial angle/shading definition, but again I think the one on the right looks more expressive.
Wish you were in the industry working with the big heads. Good job during these past months of analytics.
Excellent work.Disney should employ you to upgrade a new cut.
Much much better 👌🏼
I mean, please, can this not be incorporated into the actual movie? It's perfect.
I'm always impressed that people are able to do stuff like this. I've never understood how, but boy is it cool.
That being said, I think there might be something broken in my brain, because while I certainly can see the differences between the two, I never experienced the uncanny valley stuff that other people did. The original never looked bad or fake to me like it did for others. Even in this one where I can literally see the side by side comparison, they look different, but my Fake Human Detection System is never set off.
It might sound strange, but your approach managed to reintroduce some face movements and emotions, which were present with Peter Cushing image in A New Hope, and were absent from Rogue One.
The voice actor is perfect
Impressive. Most impressive.
I actually prefer the original Tarkin,,,CGI ,,, but it was a thrill when I watched Rogue 1 to get more of Tarkin,,,he is just so ruthless...I got goosebumps when I saw him in the reflection of the Stardestroyer window, before he verbally laid into Krennik about losing a very vocal cargo pilot! 😅
Looks great, the problem with the old one was they didn't correct the fact that he also looked much older because they took his cast from a later movie. In yours, the movements are more real as well as the texture and coloring.
Holy hell, this is wild~
Perfect!!
3:32 sums it up
Perfection
Did you use Charles Dance as a model for Tarkin's expressions? The eyes, mouth, and brow movments look very much like him.
Makes me want to see a brand new Dracula film with Cushing and Lee...
The skin looks great. The head movements are still a little weird, especially when he first turns around while watching the super laser dish being installed through the window. I wonder if the height difference is playing a role too. He seems way taller and bigger than the actor tarkin, maybe we're just not used to seeing him filmed from the lower angle and so it doesn't feel real.
This looks so much better than the original.
I hope Disney consider editing this deepfake onto the movie on Disney+
The only jarring thing is when he's facing away and turns around and he is the CG model and the deepfake texture suddenly snaps on.
I found myself trying to follow the dialog and story rather than glare at the effects, which is a sign of good effects.
I have nothing new to comment about your very well made deepfake but I can say that I never realized Krennic had a lisp...
looks so much better. When was Deepfake tech invented?. Surely they could have done a better job in the movie. It's one of the main things that hurts the film.
You know what we wait for now, dont you? There is a certain tv episode of a star wars series, wich offered a cgi face that needs to be fixed....
this is the best deepfake and beautiful. If Disney apply what you fix for these to the Star Wars character, it would be definitely real to see on the big screen.
I never really understood all of the hate CGI Tarkin got. Before this movie something like this had never been attempted (as far as I know of) and for a first attempt I think they did a pretty good job. Yes, it’s not perfect and does look a bit uncanny, but still a pretty good job for the first try. This deepfake though is phenomenal! Now that looks like if Peter Cushing was alive and actually present on the set, well done!!
I have a request - As a tribute to the late David Prowse, are you able to put his face in the reveal of Anakin Skywalker, when Luke takes off Vader's mask AND when he is seen as part of the Force with Obi Wan and Yoda??? Poor David Prowse was tricked into NOT being used in the scenes and was heartbroken. It would be a fitting tribute to the man.
Hayden Christensen would be better.
I would actually love to see both versions!
What is it about the eyes of the original that make them look lifeless? It's so hard to put my finger on it. This looks fantastic!
Woow! I hope one day they fix this in the movie and the deaging in the irishman.
Because we _know_ Peter Cushing is dead, we also know that any modern scene he's in would have to have him be computer generated, therefore we (the audience) are going to be automatically very critical. If one of the 'unknown' extras in the scene was also CGI, even if featured in a closeup, an audience likely wouldn't notice, because we wouldn't be familiar with every nuance of their face, etc. As many others have pointed out and even Jarkan acknowledges, movement is the issue. As stills they may look great, but temporally the movements are not what we are used to seeing in humans. (Especially the eyes and the lips!) I appreciate Jarkan's redo, for he strives for perfection. I believe it can be achieved, it's just not there yet. I shall stay tuned!