Virtual Production on iPhone with Unreal Engine
Vložit
- čas přidán 22. 08. 2024
- It's now possible to do virtual production with an iPhone using the Skyglass app.
Download the app FREE here 👉 geni.us/Skyglass
No PC, no trackers, no specialty software, it all happens in real time on iPhone. My co-founders and I created an app called Skyglass that allows you to do virtual production like on the Mandalorian, but without expensive LED walls. Instead we use a green screen and iPhone to do all of the tracking and real time compositing.
Subscribe to Skyglass on CZcams@skyglass_app
www.skyglass.com/
________________________________________
🎥 The Camera Gear:
iPhone 14 Pro geni.us/iphone...
iPhone 15 Pro geni.us/iPhone...
iPad Pro geni.us/ipadPr...
Sony FX3 geni.us/sonyFX3
Sony FX6 geni.us/sonyFX6
Sony 16-35 geni.us/1635G
Sony 24-70 geni.us/SEL2470
SmallRig FX3 Cage geni.us/FX3cage
Dummy Battery D-Tap geni.us/Zdummy
HDMI cables geni.us/HDMIthin
Atomos Ninja V geni.us/TheNinjaV
SmallHD Cine 5: bit.ly/3iRhdxN or geni.us/cine5
SmallHD Action 5: bit.ly/3W3nHrB or geni.us/action...
SmallRig NATA Monitor Mount geni.us/NATO2x
FX6 Tilta Cage tilta.com/shop...
(Amazon affiliate links)
==Let's Connect==
📷 Instagram: / chadwin
🖥 My Website: www.acrylicstu...
📱 TikTok / chadwin.smith
_________________________________________
#virtualproduction #skyglassapp #unrealengine5
Who is Chadwin Smith? I am an aspiring cinematographer. I love creating videos and showing others how to light and shoot better videos! I also review tech and gear. Based in Arizona, USA
Soundstripe Licenses: EERZ7LP80X0GU259, ASA4PIHOI162RVJE, IOPHBCR2YOYDEL1T
*As an Amazon Associate I earn from qualifying purchases. Any affiliate links above used may contribute a small commission to help me create new content. - Krátké a kreslené filmy
Download the Skyglass app ➡apps.apple.com/us/app/skyglass-movie-effects-camera/id1626905605?platform=iphone
What filmmaking features should we add next to the app?
IS IT A WAY YOU CAN SET UP UNREAL IPHONE PHOTOS INTERGRATED WITH THE EXTERNAL FLASH LIKE PROFOTO OR GODOX LIGHTS VIA BLUETOOTH WITH MANUAL CONTROL
@@xclusiveconnex we don’t have a way to sync up the Unreal Scenes with external lights right now. But we will be releasing AI relighting soon, so you won’t need any lights at all to match your subject to the background.
I've been following this app since before launch, I didn't know you were involved at all, lol that's awesome. I downloaded it on launch day and was impressed, but now it looks like its even more polished! Excited to see where this goes in the future! Would love to be able to make an unreal engine studio to use instead of my messy office. Also, I don't care how many chords and NDI boxes I have to run through I would love to have cinema camera support!!!!!!!
Hey, that's awesome to hear you've already been following the development of the app.
Yes, the app has changed a ton since we launched the beta last year, and it's made some great advancements since our public launch a few months ago! You'll have to take another look at some of the new features and tell me what you think!
My office always ends up a mess as well, so I'm constantly cleaning it up to make space for video production!
Okay, we'll keep that in mind. We've had some other people ask for cinema camera support too, maybe we'll add it back in the future! We just want it to be Super easy to use.
@@chadwin I totally get having the primary goal be for the broadest userbase to ensure the apps success! I also think the cinema camera features would allow for a greater pricing tear that I would pay for in a heartbeat lol also, I know working with apple ARkit is kind of complicated, but if we could get the new log video from the iPhone 15 in proress to record the composite to an external SSD that would be game-changing enough to not even require a cinema camera. Would also really help to be able to push the colors around and hide masking edges and such!
@@kylehessling2679 yeah exactly, we want the app to be useable by just about anyone!
But yes, with the release of iPhone 15, we will be adding external recording to an SSD, ProRes, and LOG support! We’re still developing that integration, but it’s on the road map!
Yeah, cinema camera support would be nice and I’d use it too-haha! But we probably won’t do it for a while because supporting every camera and lens combo out there is a HUGE challenge.
@@chadwin honestly, some of the new prores log footage from the iPhone has me thinking ill reach for it a lot more often as long as I have an SSD strapped to the back of it lol would be amazing to get those files saved in the app!
Can't wait to use it. Virtual production is the future
Heck yeah! Download it and give it a try! apps.apple.com/us/app/skyglass-green-screen-vfx/id1626905605?platform=iphone
Insane app just what we've been looking for! Couple questions:
1) Will Ai Removal work better on iPhone 15 pro?
2) Will your app support Prores Log recording when using iPhone 15 pro?
3) Can we export camera motion data from recordings so we could use it fora virtual camera inside UE or Blender for additional VFX passes?
4) Can we use UE scenes in realtime, for example moving Game character on the background?
5) Can we livestream from your app?
Did these questions get answered? It would be very good to know...
Love it 🤩 The first thing I would say is adjusting the persons lighting, then I would move into more green screen features such as spill suppression & cleaning up the edges a bit better, then I have to wonder if you can use this on a video call?
Yeah, we do have a green despill on by default that helps remove some green spill, but you could always color correct it more in post. Once we provide all layers, you’ll be able to clean up the edges better and get a cleaner composite altogether.
We don’t have the ability to use for video calls/Zoom yet. But we may add live-streaming eventually!
@@chadwin well you are on the right track 👍🏻 but definitely try to do spill suppressor live as opposed to doing it in post
This is the coolest app ever lmao I just downloaded it
Thanks!!! Hope you make some cool vids with it. Lemme know if you have any questions
What would be absolutelh fantastic is to have also our modelised 3d avatars and UE metahumans mocap playing as us (speaking, moving, laughing..) in real time (as a concurrent I won’t name you know wich one 😁)… IN all of this.
@@3ric908 yep!! We have that feature now. Just added mocap this week-brand new!! Go check it out. All in real time
czcams.com/users/shortsZ2Z_HZkFWDo?si=AkXKzKptqJkJ9Dod
Love your explanation!! So many choices!! Love it!!❤
Thank you for your support as always!! 🙌
I definiteley would love abuilt in workflow to combine skyglass with a cinema camera like you mention in the end. As amazing as the results of skyglass already are on a greenscreen, it's just the iphone cameras itself that still leaves room for improvement if you want it in a more professional environment. So yes, all the thumbs up for some form of integration or viable workflow for cinema cameras =D But I think your other planned features like downloading the camera track later on or get a clean render from the server and passes of the live action footage would go a long way to maybe find a workflow in post pro to combine the results with a cinema camera recording.
Yeah, the iPhone definitely has its limitations in terms of image quality and lens choice. We think Apple will continue to make it better though!
Using the iPhone for us makes it so much easier to do tracking for virtual production. But yeah, we still may add Cine cam support!
Hopefully our new features will make it that much more useable for pro shoots!
Sick! Just downloaded. Relight especially could be invaluable for me. Interviews or location spots might be easier. I love you used the ring/ cage as an example! Combat sports events & gyms are where I shoot!
Thanks, I hope you have a good experience playing with the app and testing it out.
Yes, relighting will be VERY cool once it’s totally ready. And thats dope, sounds like you film some intense content!
You should add support for external lenses. A button that Flips the orientation of the camera lens for Beastgrips DOF adapter to work.
Looks amazing. Sadly this app isn’t available in other region. Any plan to launch this app overseas?
Thanks! Yes, stay tuned. We’ll be adding more regions and countries later this year. What country are you in? We’ve had a lot of demand for India, but since opening up Europe I haven’t heard much else.
Good day, is Skyglass limited to only one focal length? Can you zoom in / zoom out with your ipad / iphone while shooting via Skyglass?
Congrats Chadwin, this is great news. Amazing how quickly you guys are developing the features. Any expected timing on the Pipeline Integration you mentioned?
Thanks again! Yes, we’re finishing up upgrading to UE5.3 and hope to have the pipeline integration done in the next month.
Any idea when the app will be available on the South African store?
We're still working on expanding to more regions. We hope to add more countries early next year!
@@chadwinthe new year is leaving it’s early phase 😁. What’s the update regarding this?
This app is not working fine.Is very slow when uploading for export with AI relighting…
For 12 seconds takes over 30’ and always I m stopping it because I can’t wait.
@@NigerianCZcamsr the AI relighting is a very server intensive process, even for short video clips. It’s best to upload the clip and after you see it enter the queue, you can leave the app. We’ll send a push notification once it’s done. Sometimes it’s 30 minutes and sometimes it’s a few hours. It depends how many other clips are in the queue ahead of you. It does work though! Just gotta be patient 😁
Do we need Iphone pro for it. Just an iphone 13,14 or 15 would do it
airplay to my Apple TV or Mac is behind a paywall, I really wish some basic functionality was not taken out unless you pay. But I get it.
Yeah, we're thinking about allowing AirPlay to AppleTV on our entry plan, but still not to free. I get that it's really nice to be able to see your shot externally on a larger screen than an iPhone.
Can 3d world meshes from blockade be used without being put into UE? This app is fire bro!
Yes, all of the AI generated environments from Blockade are rendered locally on device, we don’t use UE for them.
What about exporting recorded camera data for 3d software?
Yes! We save all of the 3D motion tracking data. You can access it as a USD file and import to Unreal Engine or other software. It’s available on our Studio plan. You can try it out on a free trial!
Hello is this only for iphone 14 pro and 15 pro?
You mentioned that you tried ways to get external camera feed but it was complicated and expensive, maybe you did know about the Accsoon SeeMo and SeeMo Pro. I pray that you work out an integration with the Accsoon SeeMo which is world’s first and still the only MFi certified video adapter supporting up to 1080p 60fps in without any lag whatsoever. SDK for integrating this device with Third Party Apps are available and free. At $170 for the 1st Gen SeeMo (HDMI only) and $370 for the rugged built professional 2nd Gen version (HDMI and SDI in/out), I believe the price makes sense.
However, you could also utilize the new UVC support on iPad with USB-C
guys what did we android users do to u????????? why everyone is making app for iPhone 1st even though android users are 70% worldwide 😫😫
For real!! These Apple people... 🙄😒
Haha sorry! My co-founder is an Apple Developer, so we only know best how to make it for iPhone right now.
But in the future as we grow, we’d love to add support for Android!
Android could not handle it apple has better ram and proccesers
@@SoftexplodeI hope you're joking lol, iPhones have less than half the ram of comparable Android phones. The CPUs are pretty comparable though.
@@SoftexplodeiPhone hardware is nothing compared to Android's
Amazing
Thanks!! 🤜
How is this different than the inbuilt vCam in Unreal Engine?
Vcam only works when directly teathered to Unreal Engine on a local PC. it also doesn't show you a real time composite of the scene. It only shows the virtual world. Skyglass shows a real time composite from just your phone with no need to connect to anything else or know how to.
where can I get the plugin to export some unreal environments?
Yeah, watch this video! It shows you how to export files for the app using our plugin.
Follow the link in the description for updated step by step instructions. The video is a little out of date. You must have UE 5.3 now.
The link in the description also has the website where you can download the plugin. You must be subscribed to our Studio plan to use custom assets.
czcams.com/video/_oXgENuVQjI/video.htmlsi=uAeWnm0N97Ud97gM
Also feel free to join our Discord for more tech support. discord.gg/Xbxdve8bHe
Is it possible to use our own Unreal engine scenes from our own projects to stream in real time to skyglass?
Yes! Absolutely.
You can create your own Unreal Engine scenes or buy your own assets, then simply export them with our Skyglass Forge plugin and they’ll be ready for use in the app. Requires a Studio Plan, which you can try a 14 day free trial of now!
The app not available in Australia 😭
is there for android
Iv already purchase my iPhone 13 pro in order to use the app but it is not available in argentina 😢😢😢😢😢😢😢 im really sad please help
Get a vpn
is it still in spesific country only ?
It’s available in the US, Canada, Mexico, and all of Europe. Where you located? We’re planning to open more regions still.
i'm in south east asia@@chadwin
I try open in my email or phone #, yahoo or so for skyglass but its still not work.. big problems. I dont understand.
Have your tried logging in with “sign in with Google or Apple?” Those work the best and quickest. Or you can make a new account with your email address and you should get a confirmation email from Skyglass. Join our discord if you’re still having issues
@@chadwin same email both or new create but still not work.. its very hard apple but only android can work.
Can I import 360 images from a 360 camera?
Yes, you could definitely do that. You’ll need to put the image into the Files app under Skyglass>Assets. Then it will show up in the AI generated scenes library of the app
@@chadwin Cool - I will give that a go. Keep up the great work.
@@chadwin Worked perfectly! Thanks again.
@@vidaveo8666 that’s awesome!! Glad to hear it. You can share results on our Discord if you want
@@chadwin Just tried to use a 360 video, but didn't work. Is there a specific file type, file size that I should use or does it not work with 360 video at the moment? Thanks again, very much enjoying the experience.
So sad it's unavailable for my region..
Where are you located? We’re adding new regions in the coming months.
@@chadwin Thank you for replying my comment! I'm in Malaysia.
on may 1924 It's no longer free :(.....
First comment woop
You win!! 🏆haha!