Data Wrangling 101
Vložit
- čas přidán 8. 07. 2024
- Happy Sunday, everyone!
How are you all?
Today's video may be dry but its a very important thing to know if you want to work in Camera. Data Wrangling! Hope you didn't fall asleep :)
This is how I've been taught and there are variations on this style but the principles are the same!
I apologise for the lack of video last week, freelancing got busy again and I ran out of time. Also, gee I know I look sick in this video but I really wasn't haha! Not sure why I look that ill.
Also apologies for the changes in exposure. My camera is very very sick. Will need to get it fixed ASAP!
Hope you got something from this video and if you have any ideas of things that you want to see in a video, leave a comment below and let me know!
F xx
Link to ShotPut Pro 6 (not sponsored): www.imagineproducts.com/produ...
** My Kit **
MY COMPACT CAMERA: amzn.to/2R8iS3c
THE BEST LENS: amzn.to/2LUxxZU
MY MAIN CAMERA BAG: amzn.to/2VAAkvI
MY GO-TO GIMBAL: amzn.to/2Rc6UG1
BENDY TRIPOD: amzn.to/2Vx6Pev
MY BIG TRIPOD: amzn.to/2RtgYtx
MY PRO CAMERA: amzn.to/2VyOehW
GREAT MIC FOR DSLR: amzn.to/2RvLCCt
THE BEST WIRELESS LAPEL: amzn.to/2AuImxu
MY MAIN LIGHT: amzn.to/2VAtird
MIC FOR MOBILE FILMMAKERS: amzn.to/2scLDgd
DISCLAIMER: Any Amazon links are AFFILIATE links. This means I gain a small commission for any sales made when you follow those links. This in turn supports my work and this channel so thank you! :)
SOCIALS
Twitter: / feliciacine
Instagram: / feliciacine
Facebook: / feliciacine
Music: ‘Tropic Breeze' Sarah, the Illstrumentalist
Awesome music for CZcams: www.epidemicsound.com - Krátké a kreslené filmy
Welcome to all the new subscribers! Lovely to have you here. I hope, despite how dry this topic is for a video, you learnt something from it. Let me know below what you would like to see on this channel. :)
As a long time Loader, just wanted to make a couple comments. In the U.S., on most projects, the 2nd and Loader are 2 different jobs. Small budgets and some commercials, you might be a loading 2nd. Living in the southern U.S. with heat and humidity, we don't put the tape over the pin ends. The reason is with the heat, the glue residue can stick onto the card which can then gunk up the reader or the camera. Most of us put blank P-Touch pieces on the card so we can write the card number directly on the card, as well as the mag tag, which alleviates the need to put another piece of tape on the card, which is an effort to not add to waste.
And it doesn't matter which checksum you use, this doesn't get said enough, the checksum doesn't ensure the footage doesn't have issues, but just the number of files and size match. So it's important to scrub the footage, I know Loaders, as well as production, think the checksum ensures the footage is good and it doesn't. Which is why scrubbing is important, and make time for it. Like film loading, you should figure out your system and do it the same way every time, and not to change it because the 1st time you do, you'll get burned.
As far as computers, in the U.S. almost everyone uses Mac's, a few people use pc's but it's rare you will see one on set. And you don't have the latest, greatest computer because if you're just dumping footage, having every bell and whistle maxed out won't make a difference if they hand you a Lacie rugged or some other cheap drive. That's where your bottleneck happens. I have 2018 and 2013 MacBook Pros and still use the 2013 because it's just as fast just for dumping cards. If I'm having to transcode, then I'll bring the 2018, otherwise the older one works just as well.
This was a good basic video, keep up the good work.
czcams.com/video/_IwMNp78VdI/video.html DIT Detailed including the humidity tape tip and the P-Touch solution.
A note about Exfat and Windows/Mac compatibility. Mac is picky about what allocation unit sizes it accepts. If at all possible, format to Exfat on a Macos system to ensure compatibility on Mac and Windows. It happens mostly on larger drives, but Mac will refuse to read/mount some Exfat drives unless they were formatted on Mac.
Windows will mount any Exfat drive.
Great value brought to you from a lady from Down Under!
Thanks you for sharing ma'am!
I love how the “my camera is sick” got me to audibly go awww and feel real concern haha
Doing my first wrangling job on in a couple of days, I’ve been taught before but it’s great to see someone else go over the same things as I’ve been taught, must mean I’m doing it right! Thanks!
hope your job went well! im also about to start doing this kind of work!
I've just started watching your entire channel cause the knowledge you have is so easily digestible and important, thank you!
Hey Felicia! Thank you so much for putting all this content together, it's already proving invaluable!
As a camera PA just getting into second ACing, this is super useful. Love the channel!!!
I done data wrangling 12 years ago on a feature film set in Sydney. i was the 2nd camera assistant & the directors personal assistant. after a week it was just to much work for me running around on set doing many other things while also doing the data wrangling at the same time. i eventually had a breakdown from all the stress. also to mention the 1st camera assistant was heavily pushing me around. he really didnt understand i had to much on my plate. i ended up just doing the data wrangling for the remaining few weeks. data wrangling was a job on its own. there was so much responsibility on one person hands to copy the files, triple check the files are copied then back up up the footage in multiple locations then return the card for it to safely be reshot on. the work wasn't just onset to copy the cards it was also backing up the cards at home way after the shoot ended late at night triple check the files and repeat early next morning onset till late night. successful completed everything safely eventually without errors. it was such a great experience.
You rock Felicia. Got a massive project coming up that requires some pretty intense DIT workflows so this video is muy bueno for me right now. Thank you for taking the time and well done :)
its not boring its technical excellence
This video has made my day. I have my first 2nd AC job in two days and I am so nervous. Thank you for making this video, it has helped so much!
Key is to just try keep calm and always think efficient and logical. 👍👍 Good luck!!
Your video was so informative to me and it made my day. it came absolutely at the right time to me. Thank you very much.
Thank you for the helpful video. I used to back up my data by simply dragging and dropping files, but I have recently become interested in checksums since I now back up to two destinations at once.
As a DOP/editor, I have found that folder structure is not always useful. Rarely do I need to know whether a file comes from card 1, 2, or 3. Instead, I prefer to rename files directly on the card with a naming structure that makes sense and to add the card number to the end of the name if necessary. For example: "2023 Feb 19 Toyota Rav4 Comercial Acam - 001". Not renaming files can lead to dangerous and confusing situations where multiple files have the same name.
When shooting documentaries or commercials with multiple cameras, I find it very helpful to arrange files chronologically according to the time they were shot. To do this, I ensure that all cameras have the same date and time settings before the shoot and put all footage in the same folder, then arrange by date. I also include any relevant information about the shot in the file name, rather than in the folder structure. Here is an example of what my files might look like:
2023 Feb 19 Toyota Rav4 Comercial Acam - 001
2023 Feb 19 Toyota Rav4 Comercial Bcam - 002
2023 Feb 19 Toyota Rav4 Comercial Acam - 003
2023 Feb 19 Toyota Rav4 Comercial Acam - 004
2023 Feb 19 Toyota Rav4 Comercial Bcam - 005
2023 Feb 19 Toyota Rav4 Comercial Bcam - 006
2023 Feb 19 Toyota Rav4 Comercial Drone - 007
Additionally, I use Mac's color-coding feature to help differentiate between cards and to assign colors to good shots.
Checksum software seems overpriced even tho they are among the easiest to code. there are even tutorials about how to quickly code your own data wrangling software. that's why I use Davinci's new CLONE feature but I agree it could be better. Mac can also checksum using Terminal but that might be next level for most people.
I loved this video. Made me feel more confident with my first set
Great vid Felicia. I envy your organization skills.
Just found this channel, fantastic stuff. Thank you for such a wealth of information.
FELICIA! This helped me a lot!!! Thanks for sharing your knowledge
This was great! Thanks for doing this. Not boring at all!
C'est très bien et très clair ! Merci Felicia.
I wasn't aware of offloading software. Very helpful video!
Thank you so much Felicia! I have a 2nd AC/Data wrangling gig and l was seriously nervous about it all but you've honestly helped so much! I'm not usually the one to comment but l really felt like l had to this time.
Thanks again!
- From a fellow Australian :)
Not a worry at all, Bec! Glad it was a helpful video for you 😊
Legend. Thanks a mill!!
Hey Felicia! doing my first job for Nickelodeon this Monday. And was really nervous. Really aprecciate your tips. Calms me down. Ill do a great job now I hope. Have a great year.
Wonderful! Just stay cool headed and keep everything organised. You'll do great!
I've got a job interview for an editor in a few days and data wrangling was in the responsibilities of the job description, I'm feeling a bit daunted, I'm fresh out of film school looking for work and I have this fear that my lack of experience in certain areas such as data wrangling will jeopardize the interview but I'm glad I found this video. You explained everything well and I now have a basic understanding, so thank you!
how is your career doing now?
@@gabbehs3417 I got my first job! Been at it for 2 weeks now, feels good to finally get started :)
@@theCART00N1ST sounds great! i have my first job as 2nd ac tomorrow. its a pretty big project and i am a little bit scared haha
Thankyou so much! I'm a film student currently studying in Sydney and about to work on my first Masters degree set (i'm only in the BA) as a Data Wrangler. This definitely helped calm some of my nerves, but the irrational fear of messing something up is still there... oh well.
That irrational fear sticks around a looooong time 😂
All the best!
this video is so helpful. Tks for sharing your knowledge
Excellent info! Thanks!
You're very welcome! Thanks for watching 😊
Thank you for your videos they have been really helpful God bless
Hi! from Data Wrangler here in Philippines!
Thank you!!!
Heyy this is so helpful! thanks !
So awesome
Thanks you for your videos, they are very helpfull ! they help me to be ready for the job of camera assistant ! ( I write to you from France :) )
Merci, Pauline! It's always lovely to see these sorts of comments. 😊
Nice interesting info! On my first 48H where i was DOP I just took the card out and brought it to the editor and she did the data handling. Also I used 2x 256gb in mirror so I could shoot the whole day without any other cards.
Yeah wonderful! Ah yeah its really nice when the editor does it too. They can set it up exactly how they want!
Subscribed! Thanks for sharing
Thanks for watching and subbing!
I appreciate you making this video. I am a data Wrangler and when I started there weren't any videos really on this topic. I am sonn gonna be on a shoot after having being out of the Industry for over a year, so I definitely found this helpful and refresh my memory. I like the idea of the bin a lot. I might steal that idea from you lol. I must ask though, what power station was that? I liked that the USB c dock you had, had pretty much everything on it. I want something like that for myself.
Also something to think about, I recommend getting a UPS over just a regular surge protected power strip. That way if power is ever lost, everything would still be running. I plan to add one of them if this gig works out. We shall see.
Of course! Yep I agree with you there. Nice to see your comment because I don't do data for a living, it's occasionally a part of my job but it's not the only thing I do so I don't have perfect knowledge on it. Always good to see suggestions and more insight from people who know a lot more! All the best with your next gig!
Amazing video! thank you so much!
I have a question, can you copy to 2 drives from the card at the same time?
Absolutely. Just assess if it slows down your transfer too much. Sometimes it's faster to do one at a time, strangely enough. All has to do with how good your hardware is.
Fantastic and well produced video. I/O Coordinators, could you please publish a video regarding the ins and outs of this position? I am very interested in it due to it data collecting, sorting and distributing which is what I love to do but there are no videos regarding the details of this position. Great channel! Liked, subbed and rang the bell.
I lost a 7 hr shoot because my SD drive reformat itself mid shoot. Lesson learned. None of anything I’ve ever learned or no matter what I’m skilled at; it doesn’t matter if you lose all the footage
Can I use Premiere Prelude instead of shotput pro?
Hello from Russia. After back up data wrangler need use parashoot!)
Ooo I will have to look at Parashoot. Not used that before. Thanks for watching!
good shit
damn i got lost for a sec, i was searching data wrangling for data science (IT) and suddenly you talked about videos and stuff and i got confused lol
Hello Flick, I work as 2and AC, I sometimes lose some job because I can't do data , I was bit scared because I don't understand Apple software, and I see everyone on set use Apple MacBook, so can I do data with Windows laptop? Wat do you recommend me?
Where do you get your camera tape from?
Wow, this channel is golden, so much knowledge, thanks Felicia. Btw your IG handle does not work, thought you might wanna know that
What is the dell dock you have there?
I'll have to check for you! Can't remember the exact model. Picked it up when I bought my laptop. It's USB C and also charges the laptop when in use which is great!
Is the data wrangler the equivalent role of a DIT?
I believe the DIT is a little more involved than just data wrangling. I've never actually worked on a set with a DIT but from what I am aware they also keep track of the imagery, making sure that the exposure, framing, everything works in the way the DP intended it to look and if anything is wrong or won't work in post, they will notify someone so it can be redone before that issue arises in post production?
Do you just use gaffer tape to mark your cards?
Nah, not Gaffer tape. That is way too strong for something like this. Camera tape or Permacel/fluoro cloth tape are usually what is used. At least over here in Australia that is what is used in the industry. :)
@@flickcine Okay cool, the video was very helpful, thank-you!
100th comment! .... Thanks for the insight
Hello! Big fan! I've learnt a lot from you (and also got a discount on a clapperboard as you may be able to tell from my profile picture).
I was wondering if I could ask you some more specific questions re:data wrangling via email or some other means of communication?
Or if you could point me in the direction of any suitable Data Wrangling/DIT forums that might help me, that would really be appreciated.
Love your videos, and I learn so much from them (I no longer dress in all fuchsia on set!)
Hey John! Yeah I can try answer what I can via email if you like. Email is in the about section of my CZcams page. 😊
I'll try my best to answer what I can!
HI FELICIA..... FROM SPAIN.
Can you say me ..... the diferences between “RUSHES” and “BACKUP”
Thank you
MARCONIA Filmaking ‚Rushes‘ is the copy being sent to the editorial to work with, ‚Backup‘, as the name states, is the Backup, this usually should stay at a different and safe location.
‚Backup‘ then should only be used if something goes wrong with the ‚Rushes‘ copy, e.g. hardware failure etc., otherwise don‘t touch it until production is finished.
Thanks so much! So sorry MARCONIA Filmaking. I didn't get a notification for your comment and didn't see it until just now with Cutter Carlo's response.
@@flickcine THANKS, CARLO and FELICIA
you ever use post haste?
No I haven’t. What’s Post Haste?
@@flickcine idk if you're on us time or aus but here's a link
www.digitalrebellion.com/posthaste/
i use it with offload to dump and backup footage.
for editing, you can set it up like this dude which is where i got the idea:
czcams.com/video/vmKEMoatxgE/video.html
i organize youtube templates for vlogs, client templates for production nice and tidy so i can find stills, raw footage, contracts, etc. you just set it up and it automates it.
Ohhhhh that looks cool! I'll check it out. I'm based in Aus
@@flickcine my ex is over there somewhere i actually have been waiting for the vaccu to approve my travel visa now since oct 2017. they're so strict my cancer treatment was even an issue. i had to have a physical and tons of tests and turn all that over to your govt. lol. hoping covid makes them expedite things to boost tourism and this is approved finally soon haha
That's a looooong wait! All the best with it 😊
What laptop are you using here?
Heya, Carmen. I'm using the Dell XPS 15 9570 (core i9) :)
@@flickcine Oh cool. Thanks for the reply. I'm getting into DIT and been looking at laptops and I still don't know what to get :)
You're welcome! The industry standard (well at least in Australia) is MacBook Pro If that helps. But the XPS 15 is a great alternative. You just have to remind production that you'll be formatting drives to EX FAT so they can be used on PC and MAC. :)
@@flickcine I also live in Australia so I've been thinking of either getting a new Windows or a second hand MacBook Pro (one with lots of ports). Love your videos Felicia! Gets me through uni
@@flickcine Worth noting if you are using an Alexa you need to be using Mac OSX unfortunately.
what is Dartar?
The Australian accent is pretty great hey! 😂
Everything about the Laptop part blew all crApple laptops to splinters! Couldn't resist laughing.
crApple laptop:
reliable? Nope
various connections? Nope
build in card reader? Nope
work with dongles? Nope
There is a reason why the professional world turned their back on crApple years ago.