The Crazy Computations Inside Your Smartphone Cameras

Sdílet
Vložit
  • čas přidán 29. 01. 2022
  • I recently got an iPhone 13 Pro. I love it. For me, the thing that sticks out most - literally - is the camera. Virtually all of today’s top smartphones can take images on par with anything you can get with a standalone.
    How does your mobile phone camera work? And how did it get to be so good? In this video we will look at the amazing computer and semiconductor engineering that goes inside this impressive feature.
    Links:
    - The Asianometry Newsletter: asianometry.com
    - Patreon: / asianometry
    - The Podcast: anchor.fm/asianometry
    - Twitter: / asianometry

Komentáře • 582

  • @Asianometry
    @Asianometry  Před 2 lety +45

    Like and subscribe. Yada yada. Check out other deep dives here: czcams.com/play/PLKtxx9TnH76RiptUQ22iDGxNewdxjI6Xh.html

    • @pat8988
      @pat8988 Před 2 lety

      I believe that the blurred background of the cup is a normal effect in low light conditions for all cameras. It’s due to the depth of field becoming shorter with a lower (numerical) f-stop.

    • @gordongecko5412
      @gordongecko5412 Před 2 lety

      The conclusion is a masterpiece ! Thank you !!

    • @ntabile
      @ntabile Před 2 lety +1

      The MEITU image at 9:24 -9:30 is funny!

    • @myentertainment55
      @myentertainment55 Před 2 lety +1

      My mom said the same about my voice!
      Maybe it's some biological explanation here :D
      Listening to voice of their kids makes mothers very calm and relaxed.

    • @El.Duder-ino
      @El.Duder-ino Před rokem +1

      Very good "food for thought" that people rather take unreal, but nice looking photos than the real ones... this give us back the answer that people prefer fake than reality.

  • @ClockworksOfGL
    @ClockworksOfGL Před 2 lety +397

    I’m glad you pointed out something I’ve been saying for years: you’re not seeing what the camera sees, you’re seeing what the phone generates. It’s not a bad thing, because the raw data coming from that sensor is close to unusable. Optical designers can’t overcome the laws of physics.

    • @mychemicaljojo
      @mychemicaljojo Před 2 lety +9

      The video puts it so well! food for thought, man.

    • @insu_na
      @insu_na Před 2 lety +27

      That's not quite true... Many phones nowadays allow the saving of for photos in raw format, which does bypass the image processing pipeline of the phone. Sometimes entirely, sometimes only mostly. Either way the image you get from that is *far* from unusable. Often you can make these raw format photos look leaps and bounds better than the standard processed ones. If you just let the phone to its thing you have 0 control over colours, white balance, denoising, lense correction, etc.
      The phone just guesstimates some appropriate values and if it guessed wrong, well tough luck. Usually it guesses decently, but it can't beat full manual control.
      Now obviously none of that matters to the average person just trying to take a photo for Instagram or Facebook or whatever, and most people who want nice and accurate photos will use a DSLR, but sometimes you don't have a DSLR with you but still want to take a good photo.
      Long winded way of saying: no, raw camera data is very good actually and if you really value quality of the photo over ease of making it then you'll choose the raw data over the processed image

    • @daniel_960_
      @daniel_960_ Před 2 lety +26

      Your brain actually does the same thing. What your eyes see is not what you perceive, the eyes data also gets quite heavily processed.

    • @MaxoticsTV
      @MaxoticsTV Před 2 lety +2

      @@insu_na Let me give short winded retort, no, small sensor raw data will never match larger sensors. It's the physics. Whatever they figure out for them would just be multiplied into larger sensor DR. How many photon-bumped electrons can a cell camera count versus a large sensor camera? You're right, one would always choose RAW over anything else, but the fact remains, RAW "what"?

    • @insu_na
      @insu_na Před 2 lety +15

      @@MaxoticsTV Did you even read what I wrote? Did you see the part where I said that DSLRs make better images? Should you maybe repeat school again?

  • @doctorscoot
    @doctorscoot Před 2 lety +510

    Well, photographers have been altering their images since the beginning. Filters (darken the sky / brighten the sky), tilt-shift large format cameras, toying with exposure and film speed, ‘pushing’ the negatives, dodge and burn, retouch, etc. Now we just get fancy machine learning pocket supercomputers to do it for us.

    • @acidtears
      @acidtears Před 2 lety +38

      The "problem" is the shifting of control over to machines. If everything is done by machines, then what remains human of the image? Producing negatives is an artform and so is (arguably) using Lightroom or Photoshop for digital images. If everything is done automatically by an algorithm, nothing but the scene/subject is unique anymore. Naturally, it becomes easier to take pictures for everyone. And that's a good thing. But just like painting and other expressions of art, photography is a skill to be learned and nurtured over multiple years. Perfection through machines is not the same as perfection through practice.

    • @doctorscoot
      @doctorscoot Před 2 lety +46

      @@acidtears I never said their wasn’t a problem. Just the impulse to ‘fake reality’ has a history, culturally as well as technically.
      Also, the same type of arguments you’re using here (traditional photography contains the traces of the artist, AI does not), are the same class of arguments used _against_ photography in favour of the traditional “arts” (ie drawing and painting).

    • @dishwashersafe222
      @dishwashersafe222 Před 2 lety +5

      @@acidtears Well said!

    • @frostypurply
      @frostypurply Před 2 lety +1

      It’s about real time with software and digital assets

    •  Před 2 lety +12

      It's tool, medium.
      You could argue quite similar for audio over video, books over radio, storytelling over books, Cave paintins over...
      It's on you, what and how you use it.

  • @lidarman2
    @lidarman2 Před 2 lety +96

    This story struck a cord with me since I have been working on this stuff for 20 years. You nailed it. Just like our eyes and brains, the electronic cameras are starting to utilize all the light that is hitting the phone at any given moment. In the past, cameras just take a momentary sample of the light. But human eyes are doing it constantly...we don't have shutters in our eyes. I love where photography has gone and is going.

  • @neilmcmahon
    @neilmcmahon Před rokem +48

    Man, I've been watching your videos since I am working on EUV processes and really think each of your videos is like a PhD thesis in visual form. They are so informative in a way that reading isn't. Despite your self-deprecation, I can sense that you are a deep, intelligent individual.
    Your humour appeals to me. You have a dead-pan delivery that is geek-unique.

  • @DanafoxyVixen
    @DanafoxyVixen Před 2 lety +145

    It needs to be remembered that all the advanced computational processing that happens with smartphones always trickles down in to the bigger DSLR/mirrorless cameras, when also coupled with larger more "optically" superior lenses, full size cameras will always be better. but having said that, modern smartphones are "good enough" for most people

    • @Mia-ln1zs
      @Mia-ln1zs Před 2 lety +2

      You have a point, but there's a hard limit to how "good" an image can be. From a physical perspective. Arguably cameras have already surpassed that point and further manipulation is simply to please the viewer. A DSLR isn't necessarily technically superior, but you may find its rendered image more pleasing.

    • @cyzcyt
      @cyzcyt Před 2 lety +18

      @@Mia-ln1zs err no. The whole point of improving image quality is to improving a more pleasing render.
      The physics of having a small form factor like a smart phone, will always be technically inferior to a bigger format camera.
      That's the whole reason why a front camera recorded TikTok video will never look like a properly produced talking head studio recording. Even tho both is just basically the same content as the subject is basically talking to the camera
      The "hard limit" is still a long ways away.
      Sure there will be a point where the smartphone's output is good enough to be consumed, but that's hardly a hard limit. Because at that point of time, the bigger camera's output will be still pushing the limits on what's possible. So it's forever a never ending chase

    • @watchout5508
      @watchout5508 Před 2 lety +5

      The performance focused chipsets in modern phones will always Trump that of the latest dslrs, sure they don't have the hardware when compared to the more hand held cameras BUT that being said, smartphones are designed from the ground up to be your primary device for almost everything and in that regard the cameras are also advancing rapidly might i add!
      Now id love an amazing DSLR but when do we most feel like taking pictures? When we plan it, or simply in the moment.
      Then for the moment having such a powerful camera in our pockets is simply mind blowing!
      I love the advancment of our little rectangles and cant wait to see where they head! Likely AR glasses...

    • @robinrai4973
      @robinrai4973 Před rokem

      I have yet to see a DSLR or mirrorless camera that does the image stacking smartphone do, I really wish pocket cameras would do it, because stacking alone produces incredible results. If CZcams would allow me to post links I've got a comparison between a modified smartphone with a nearly 1 inch sensor happily keeping up with a Ricoh GR III!

    • @TheDiner50
      @TheDiner50 Před rokem

      @@robinrai4973 There was ones cameras with full out smartphone features like screen and all. Or close to it. What we need are phones that are a bit thicker and even maybe have a camera bump to boot. That basically is a blend of a camera and a smartphone. Like yea maybe the phone is to big to have in your normal pocket. But like it still can be totally a thing one want to carry around. Like keeping the size down from a XL phone and just add extra thickness should totally be still mobile and pocket friendly enough for most people. Handbag and jacket/hoodie pockets are a real thing.

  • @royack
    @royack Před rokem +11

    In my humble opinion, the bokeh you were talking about with the iPhone 13 pro wasn’t a case of “Portrait mode” leaking into normal photo mode, but a result of the camera sensor size being much larger than previous sensors.

    • @salamander405
      @salamander405 Před rokem

      My iPhone 8 plus is very capable of “blurring backgrounds” with a close up subject, especially when the camera app is telling me it’s taking the photo at f/1.8. That’s really just optical physics at work, wide aperture + close subject = less depth of field on non-focused subjects.
      When he said this I paused the video and quickly snapped a photo of my water bottle close up just to make sure.

  • @MGalaxy
    @MGalaxy Před rokem +34

    15:54 iPhone 13 Pro has a bigger sensor and lower aperture compared to the regular 13 and most other phones. I bet that's why you can notice more shallow depth of field, not because of AI work. Correct me if I am wrong but I think algorithms do not mess with background blur in regular mode. Nice video btw, good compilation of history! It's very interesting topic that deserves more attention.

    • @Raja995mh33
      @Raja995mh33 Před rokem +3

      Exactly this. It's just physics doing its work here because of the much bigger sensor and also much bigger aperture - not some software

    • @michaellundphotography
      @michaellundphotography Před rokem +2

      I came here to say this thank you =)

    • @salamander405
      @salamander405 Před rokem

      As a professional photographer (who admittedly doesn’t know much about phone cameras) I immediately knew that wasn’t totally correct when he said that. Even my iPhone 8 plus achieves that shallow DOF when taking photos of close subjects with a low f/stop.

  • @dienelt5661
    @dienelt5661 Před 2 lety +69

    People don’t realize how much the image quality in smartphones is LARGELY due to the high amount of pre and post processing and smart optimizations. The sensors themselves aren’t that “good” especially when compared to classic full size sensors.

    • @chengong388
      @chengong388 Před 2 lety +3

      Yea so? Who cares?
      As long as the photo ends up good what’s your problem?

    • @dienelt5661
      @dienelt5661 Před 2 lety +29

      @@chengong388 i didn’t mean it in a bad way, I find it amazing that smartphone can accomplish so much with so little.

    • @shadowshadow2724
      @shadowshadow2724 Před 2 lety +5

      @@chengong388 they're somewhat fake photos ?!
      did you see that feature in Huwawei's smartphone (I guess) when you take a photo of the moon in night the moon looks so good and so real because of AI pre processing

    • @tomis181
      @tomis181 Před 2 lety +1

      @@chengong388 I mean sometimes you want to capture reality rather than what a company has decided looks best. Of course you can shoot some sort of RAW in many phones now but still. Or for example sometimes the iPhones portrait mode looks good a first glance but the bokeh looks totally fake when blown up to desktop (I'm sure this will improve with time)

    • @chengong388
      @chengong388 Před 2 lety

      @@shadowshadow2724 that example is totally different from what we're talking about.

  • @masononemine1702
    @masononemine1702 Před rokem +5

    And even with all that, I have grown a particular distaste for the kind of processing smartphone manufacturers do these days, and the thing is, people love that. I guess I am just not like the majority of consumers who never zoom-in to a picture, or ones who complain about over sharpening and what not.

  • @krzysztof6123
    @krzysztof6123 Před 2 lety +4

    Saying that a phone is better than a camera is like saying a moped is better than a car

  • @bearlemley
    @bearlemley Před rokem +4

    The trouble is that the lenses are subpar if you are comparing them to real cameras. You get used to looking at cell phone pictures and they started to look good until you go back a camera with a real lens and suddenly all those that see the photograph are stunned by the detail, the depth and the accuracy.

  • @JohnEnergy2012
    @JohnEnergy2012 Před 2 lety +9

    Things get even crazier when you realize the processing is so fast the same tech can be applied to video (4k60fps) as well...

  • @oceanheadted
    @oceanheadted Před 2 lety +3

    The quality of pictures from modern phones is crazy given the size of the hardware, thanks for unpacking some of the features which it relies on.

  • @tomschmidt381
    @tomschmidt381 Před rokem +5

    As an retired EE it amazes me how much functionality is being packed into such a small package. Until this video I had no idea how computational intensive digital imagining was. I assumed (know what they say) most of the processing cycles were spent on compression to save on storage space.

  • @MaxoticsTV
    @MaxoticsTV Před 2 lety +11

    Great job! Most non-photo nuts flub much of it. Many in the comments are confused because you didn't hammer home this--cell phone cameras USE COMPUTER PROCESSING TO MIMIC WHAT YOU'D GET FROM A REAL CAMERA. Yes, I know you said a few different ways. I agree. They do an amazing job! So if you want to take a photo with your iPhone 13 that looks like something you took with a $3,000 camera then you will not be disappointed.
    But that photo is a computer generated image using very noisy image data from your phone's camera. It's like having a street artist paint a realistic portrait from your polaroid (in my day)
    Hard-core photographers aren't interested in whether something looks "professional" or not. They are trying to focus on a specific visual truth. You can only get that through exact focus (which is hard to do manually on a phone). Natural optical bokeh (impossible on phones). Then there's exposure. Again, too time consuming on phone. Phones will not replace large cameras because the sensors are too noisy in most light--full stop.
    You should have covered curved sensor development btw. Also, Foveon technology is worth exploring. It doesn't use filters. I would have said sensors are color blind in your video, but that's quibbling. If you're reading this I LOVE your stuff, pass it on to anyone I know who has an interest.
    Also, Samsung pretty much left the large camera business even though they developed cutting-edge tech and had a cult following. Definitely worth a video from you!

  • @MoritzvonSchweinitz
    @MoritzvonSchweinitz Před 2 lety +7

    Please, please, please make an episode about the manufacturing process of all those components!
    How are this Bayer color filters produced so small, and aligned perfectly? How are zillions I'd super precise micro lenses made? How does optical imagine stabilization work that quickly and precisely?

    • @MaxoticsTV
      @MaxoticsTV Před 2 lety +1

      DITTO!

    • @gibbogle9486
      @gibbogle9486 Před rokem +1

      I am also interested in the manufacture of the lenses. This is an aspect of the technology that is often overlooked.

  • @nomore-constipation
    @nomore-constipation Před 2 lety +2

    All my photos taken on any digital device seems like a lie now. I abandoned the older way because I thought the future was digital photography.
    Goes to show you, old school lenses are the only way to get actual pictures from a object or subject.

  • @stephencampbell9384
    @stephencampbell9384 Před rokem +2

    One of the best overview explanations of this field I've seen, good stuff.

  • @michaelludvik2173
    @michaelludvik2173 Před 2 lety +2

    What about the LiDAR feature on the iPhone 13pro? Agreeed that the computation “improvements” are a bit flawed philosophically but LiDAR is truly new 3d data we have to work with.

  • @kuantumdot
    @kuantumdot Před 2 lety +1

    Very Well done!! I only get a glimpse at the how the image processing is conceived and executed but I can concur with your video here. It’s is astounding to see how amount of thoughts and executions going behind the scene of each selfies

  • @Paulkjoss
    @Paulkjoss Před 2 lety +4

    What’s crazy is how you keep finding such interesting topics to cover dude 👍🏾

  • @gameshot911
    @gameshot911 Před 2 lety +1

    Dude your videos are so, so good! The graphics you track down are super cool and informative, and the explanations have great flow and are really intuitive. Plus you pick interesting topics! Keep it up!

  • @MrKelaher
    @MrKelaher Před 2 lety +6

    Really good ! A couple of other fun ones where computation is key:
    1. simulating more zoom levels/smooth zoom from multiple fixed levels and parallaxed sensors
    2. using these parallaxed sensors to complement depth sensors in deeper fields where dedicated depth sensors fail
    3. enhancing low light performance of the "zoomed" sensors by using the wider ones
    4. using multiple sensors to calculate "field flow" to correct shake and pan blurs
    5. On that note, using multiple sensors in the video domain to simulate filmic effects like focus pull
    Just so many things one you have a matrix of sensors and a crap load of CPU/GPU !
    One annoying marketing thing Apple do - some "exclusive" features of new phones COULD work on earlier ones, and sometimes quietly sneak into subsequent software releases on older phones (Bokeh being a prominent example)

  • @tomis181
    @tomis181 Před 2 lety +90

    Good vid. It seems camera sensors themselves haven't improved greatly in the last few years. Or at least not nearly at the pace they were previously. For example, a great low light camera, the Sony A7SII to A7SIII did not see a huge improvement in low light performance despite a five year gap between releases. Maybe I am expecting too high a pace of improvement for digital sensors and they won't ever be able to compete with image intensifier tubes. For dedicated cameras I understand wanting personal control rather than computer control for taking shots but I do hope the big manufactures begin taking more advantage of computational photography in areas where a photographer can't easily improve it by manual controls- low light, star tracking, focus stacking.

    • @hobbykip
      @hobbykip Před 2 lety +21

      Most optimizations are done on speed, pixel decity and the ability to handle special scenes (like requireing HDR). The CMOS technology is near its physics limit als noise is so low and the 'bucket size' of the pixel is difficult to increase (they call this technology deep trench isolation). Anyway, hopefully SPAD technology will better the sensitivity and thus performance.

    • @tomis181
      @tomis181 Před 2 lety +1

      @@hobbykip thanks for the insight. I wasn’t sure of the exact tech and what to expect for the future but did notice the “stagnation” of CMOS. Will look up SPAD.

    • @krzysztof6123
      @krzysztof6123 Před 2 lety +2

      A7S is primarily video camera

    • @tomis181
      @tomis181 Před 2 lety

      @@krzysztof6123 I understand that. Everything I said still stands

    • @acidtears
      @acidtears Před 2 lety +5

      I think that low-light mode is pretty much a gimmick. I say this based on photos I've seen, not on personal experience. There is an art in using a digital camera and different lenses to capture as much light as possible. However, at the widest aperture and highest iso, things should stop becoming brighter. If you want to enhance the brightness further you can always go into Photoshop or Lightroom, but the image taken by the camera remains (in my opinion) a far better representation of reality.
      Low light is difficult to shoot and I do think that certain improvements should be made to the imaging processors. But as it stands, I prefer to shoot "RAW" or even JPEG on my Fuji than artificially blowing up all aspects of my image for the sake of - people wanting it? Light is the most important aspect to photography and for casual users, using a ML algorithm to blow it the fuck up might be the best way to go. For anybody else, time and patience, persistence and determination - those are the key factors to "winning" in low-light and producing great pictures.

  • @creepychris420
    @creepychris420 Před rokem

    bro you are so good at explaining yourself, you are very listenable - i usually watch the pictures too but i can understand it all without looking usually. ill check out the podcast no worries

  • @dominicus9891
    @dominicus9891 Před rokem +4

    15:46
    That's actually natural bokeh on the glass there, the same as on a DSLR or mirrorless camera. It only pops up on the glass because it's so close to the camera.
    You see more and more of it nowadays because of the physically larger, and subsequently more telephoto lenses to match in modern phone cameras.

    • @PeteC62
      @PeteC62 Před rokem

      Yeah, I can get very similar bokeh with the main camera on my Galaxy S22 Ultra (though I'm not super impressed with the quality of the bokeh in the pic in the video, tbh).
      What's interesting on Android these days (not sure about iOS) is that you can add blur to _any_ photo, not just photos taken in portrait mode (and for that matter, they don't even need to have been taken on the phone's camera!) They do "depth from ML" segmentation on the image, and just apply blur based on the depth at the selected "focus point", and virtual f-stop. The Light L16 could do the same thing, but in that case the depth map was from stereo, not from ML.

    • @dominicus9891
      @dominicus9891 Před rokem

      @@PeteC62 In my opinion, I prefer real bokeh just because I can be guaranteed of the authenticity, there can't be any "error" to it, besides an out of focus shot.

    • @PeteC62
      @PeteC62 Před rokem

      @@dominicus9891 I totally agree. The quality of artificial bokeh depends on so many factors, like the accuracy of the depth map, and the way the blur is applied (low end software will just apply a simple gaussian blur, whereas better software will try to mimic the shape of the aperture blades, at the cost of slower processing). It's fine for making the subject of a portrait stand out from the background, but you're unlikely to get great bokeh balls...

    • @dominicus9891
      @dominicus9891 Před rokem

      @@PeteC62 There'll be a time in the near future where I believe the depth map itself will be doing the brute of the work to mimic the effect, instead of the "edge detection" which is needed now.

  • @TheOneG36
    @TheOneG36 Před rokem

    very well explained! thank you for that!

  • @Erik-rp1hi
    @Erik-rp1hi Před 2 lety +1

    Putting a bunch of images together to get the effect of a big lensed DSLR camera works pretty good.
    Good report.

  • @StoicGore
    @StoicGore Před rokem +1

    I finally got a stand alone camera. So glad I don't have to upgrade every year and holding a camara feels so much better than something made for talking.

  • @shadypark78
    @shadypark78 Před rokem +2

    The camera should take the most accurate photo possible. I'm aware that all engineers see differently, and that there are a lot of variables, but effects should be added after an accurate photo has been taken. I use Light Room and all kinds of other software, but require a raw, accurate, uncompressed photo to start with.

  • @leonmartinville7628
    @leonmartinville7628 Před 2 lety +4

    Bonsoir, toujours des super vidéos. Quelle synthèse. Vos compétences sont immenses. Bravo

  • @indianajanes1182
    @indianajanes1182 Před rokem

    Fantastic in-depth presentation.

  • @prakadox
    @prakadox Před 2 lety

    Great video. The quote at the end, cherry on top of the cake!

  • @AdityaChaudhary-oo7pr
    @AdityaChaudhary-oo7pr Před 2 lety

    your research and documentary are very very informative!! Thank you for making such videos

  • @canalsentir
    @canalsentir Před rokem +1

    Great video about the technology of cameras and smartphone cameras in particular! We also did one just now with my hand (lol) but in the video you can see how intricately and quickly a Samsung A22 focussed and quickly changes the depth of field all automatically!

  • @shazmosushi
    @shazmosushi Před 2 lety +1

    Really great video. I forgot to watch it during Patreon Early Access. But it's a really nice deep dive!!

  • @Sagittarius-A-Star
    @Sagittarius-A-Star Před 2 lety

    A lot of new information - thumbs up!

  • @navadeep.ganesh
    @navadeep.ganesh Před 2 lety

    Great video and compilation of history. I literally was there feeling the revolution, but never explored the tech behind it. Interesting one!

  • @arnecl9566
    @arnecl9566 Před 2 lety

    Great video again! Love your work

  • @Kyuubi840
    @Kyuubi840 Před rokem

    Very interesting analysis, thanks for this!

  • @sundog486
    @sundog486 Před rokem

    Very well explained! I didn't learn much from this particular episode but I've learned a great deal from your others. Thank you.

  • @valopf7866
    @valopf7866 Před 2 lety

    Thanks for the video!

  • @opalyankaBG
    @opalyankaBG Před rokem +1

    Not sure where you've gotten this definition but a zoom lens doesn't usually take you from a long shot to a close up. Long shots are taken with long lenses (a long focal length), and close ups can be taken with basically any focal length. Zoom means the lens covers multiple focal lengths all in one.
    Another thing to note is that you can actually use a smartphone camera to get a subject in focus and blur the background - naturally that is, without using any blur/bokeh/portrait modes. However that's only possible with small subjects in close-ups.

  • @redshifted8790
    @redshifted8790 Před 2 lety

    This really is an awesome video, thanks for your work!

  • @2365Films
    @2365Films Před rokem

    Well done tutorial - Thank You!

  • @TonyLing
    @TonyLing Před rokem

    That is very illuminating. Thanks.

  • @leyasep5919
    @leyasep5919 Před 2 lety

    Yet another excellent report ! thanks !

  • @rorychivers8769
    @rorychivers8769 Před 2 lety +1

    Imagine all of that engineering, and no one thought to put a sticker on the camera reading "No one gives a shit about your facebook pictures"

  • @terryshemishere7715
    @terryshemishere7715 Před rokem

    Perfecto!!! This is my first time on your channel. Your explanation and overall video was so good that I was forced to liked and subscribed. Thanks man

  • @xenuburger7924
    @xenuburger7924 Před 2 lety +2

    Photography means writing with light, which seems intuitive when light is projected onto film. Projecting it onto a CMOS sensor through a matrix of color filters adds complexity most people would rather avoid, so the word remains the same. Thanks for the explanation.

  • @bluerider0988
    @bluerider0988 Před 2 lety

    Great as always.

  • @RobWhittlestone
    @RobWhittlestone Před 2 lety

    Very nice channel. I have seen a few videos now - including the very well-researched "The Rise and Fall of ICL". Thank you. I have a feeling I'm going to binge watch your previous ones! :-) All the best, Rob in Switzerland

  • @adrianheffernan102
    @adrianheffernan102 Před 2 lety +1

    I loved how you ended this video very well said and thought provoking, Many camera phones apply skin softening in portrait mode - crazy to think all our memories will have been doctored - it's like something from 1984.

  • @teiksengcheah
    @teiksengcheah Před 2 lety

    Very interesting I learnt a lot thank you

  • @mikelurban892
    @mikelurban892 Před 2 lety

    Great explanation, thx

  • @Patrick_B687-3
    @Patrick_B687-3 Před rokem +1

    Not that long ago (seemingly) I remember thinking how cool it was to snap a pic with a Motorola Razor. 😂😂

  • @henryD9363
    @henryD9363 Před 2 lety +17

    I have four mirrorless Sony cameras. The last time I use one was about 4 years ago when I got my first pixel phone. My pixel 4 takes better pictures than any Sony I have. By better I mean more usable better color better shadow details they just look better.
    I don't understand why Sony or Canon, etc, doesn't put the same processing in one of their mirrorless cameras. Their sales are going down down down because practically speaking they're not as good as most people's phone.
    I refuse to spend 3 to 10 minutes in Lightroom to get a couple of photos looking as good as from my phone.
    I know there's a huge, actually very small, group of photographers who want raw only and want to spend their lives photo processing. But to heck with them.
    Watch this video, Sony.

    • @clothesclothes777
      @clothesclothes777 Před 2 lety

      Doesn’t the a7s series have leading low
      Light tech? Or am I too far behind now

  • @yuraretz2379
    @yuraretz2379 Před rokem +1

    What I don’t understand is why can’t they make square sensors? That would allow taking landscape photos while holding the phone in more convenient portrait orientation.

  • @x2ul725
    @x2ul725 Před 2 lety

    Been waiting for this one - I appreciate glass more and more because of this channel

  • @sabinkayitana9885
    @sabinkayitana9885 Před 10 měsíci

    amazing work Bro

  • @Norsilca
    @Norsilca Před 2 lety +2

    Very nice. Now do panoramas! I know they can line up overlapping parts of neighboring images, but I always wondered how much they use accelerometer data to help them guess how far you've moved/tilted between the images.

  • @NPJGlobal
    @NPJGlobal Před 2 lety

    That philosophical conclusion doe.
    Food for thought indeed

  • @Muonium1
    @Muonium1 Před 2 lety +11

    I remember when I first saw a picture from a camera on a flip phone in 2003. It was absolute garbage and I literally laughed at how bad it was. The improvements over the intervening 2 decades - the CCD to CMOS switch, back-illuminated sensors, pixel crosstalk suppression, quantum-dot based sensors - have been incredible. There's still enormous room for improvement yet, only a couple percent of the area of the back of a modern cameraphone is actually collecting photons...

  • @aetibaar
    @aetibaar Před rokem

    love the video ..... very informative

  • @SyangjaliThitoMagar
    @SyangjaliThitoMagar Před 8 měsíci

    Nicely Explained.

  • @moeinmaleki7859
    @moeinmaleki7859 Před rokem

    i have discovered this channel far too late. great video!

  • @yash_kambli
    @yash_kambli Před 2 lety +14

    Smartphone cameras have come a long way, just 10years before, except some handful devices camera quality was plain pathetic in most of the devices but now their achievement is in front of us. However still i do feel that computational photography can't beat the laws of physics, they are still very profound. AI /ML creates very unrealistic looking images , oversharpen unnecessarily and colour accuracy is gone for a toss. Most frustrating though is loss of depth in the images, they looks flat and washed out which is something nokia lumia 808 was known for

    • @061Hitachi
      @061Hitachi Před 2 lety

      Photos from my Nokia N73 and N95 still look absolutely gorgeous.

  • @adramalech5109
    @adramalech5109 Před rokem

    dude i was just trying to google how camera sensors actually work and trying to brainstorm how that would be. this was rreally interesting and well made. thanks for a great video! take my like and subscription!

  • @vinayhaalgaar
    @vinayhaalgaar Před rokem

    Excellent video 👍🏼

  • @hajokerkhof
    @hajokerkhof Před 2 lety

    Impressive and inspiring video! Thnx for sharing.

  • @nerdynephew
    @nerdynephew Před 2 lety

    I feel like I’m definitely going to enjoy your content more as a podcast

  • @BradleyVanTreese
    @BradleyVanTreese Před rokem +4

    This was SUCH a good episode, especially the bit of thought philosophy near the end. How often we, as Humans, ask for or prefer something other than reality. I am quite sure this says something profound about our species and the environments we experience.

    • @jb-xc4oh
      @jb-xc4oh Před 6 měsíci

      Its the one aspect of digital photography which I really dislike.....its synthetic, a maze of mathematical computation which approximates reality, in other words....fake.

  • @atlantasailor1
    @atlantasailor1 Před rokem

    This is one of the most brilliant videos on CZcams. Congratulations! Supposing the zoom issue is resolved with the next iphone 15 or Samsung or whatever, one wonders what is left to improve in smartphones? Maybe microscopic images 100X? Who needs a telescope or microscope? Maybe you could have an image at night and zoom into a star in the sky and also into the cells of a leaf in the same image. After the image is saved…

  • @andikappradana
    @andikappradana Před rokem

    When you point the phone at the relatively close object like in the minute 15:48, it's not leaking portrait mode, it's natural bokeh of the camera because iPhone 13 Pro has a bigger sensor and f stop than the previous iPhones

  • @PaulFisher
    @PaulFisher Před 2 lety +16

    One other way zoom can work in addition to those you covered is with help from computational photography. Because your hand moves a little no matter what, by taking multiple rapid-fire exposures and comparing them, you can infer some more detail by looking at overall motion and fine transitions. This technique has been used on Pixel devices (at least, possibly others) and Google (former employer) calls it “super-res zoom”.

    • @Scrogan
      @Scrogan Před 2 lety +1

      Like traditional noise-based oversampling. When you have an analogue signal going into an ADC with a known noise distribution filling it, you can use that noise to infer bit values beyond the resolution of that ADC.

  • @PhilipLeichauer
    @PhilipLeichauer Před 2 lety +6

    Great video. It's a shame smartphones can't operate external flashes and generally lack the easy to control manual mode that DSLR cameras have. So convenient though. Glad to have both.

    • @mindaugasstankus5943
      @mindaugasstankus5943 Před 2 lety

      Do not surprise if you soon need to pay extra (subscription) for using cameras (software/bios/firmware). Compact cameras with alternative bios/firmware unlock great capabilities (CHDK for canon for e.g.). Same apply to all digital camera, but "dumding down", control/removal of ownership making tech crappier and crappier.

    • @karanvora2674
      @karanvora2674 Před 2 lety

      Sony phones have excellent pro mode. But I doubt anyone buys Sony phones.

  • @agustinbs
    @agustinbs Před 2 lety

    Excelent as always

  • @hacc220able
    @hacc220able Před rokem

    Thanks for sharing

  • @TheMamon66
    @TheMamon66 Před 2 lety

    Interesting analogy in the end for sure...

  • @n1msu
    @n1msu Před rokem

    First time and first video I've watched on your channel. Really informative and technical but at an accessible level, so the last thing I felt when watching this video was sleepy!

  • @smallmoneysalvia
    @smallmoneysalvia Před rokem +1

    The iphone 13 pro max has a really large aperture on the wide lens, it can generate real bokeh at short distances

  • @pejvaaksalimi2311
    @pejvaaksalimi2311 Před 2 lety

    Impressive video. and the message at the end was so true. People want to see what they want not what it is. ;)

  • @SpecterJoe
    @SpecterJoe Před 2 lety

    In the best way possible your mom is right about your videos putting people to sleep, Whenever you post I make sure to watch your videos as a way to wind down at the end of a long day. Thank you

  • @hunter8980
    @hunter8980 Před 2 lety

    You are the best! Always!

  • @maxhill9254
    @maxhill9254 Před rokem

    Your videos are "food for thought" :-)

  • @mortenthorpe
    @mortenthorpe Před rokem +1

    Interestingly, all of my photos, taken using dedicated interchangeable lens cameras, are commented on by people quite often, s “that doesn’t look true to the scene”, while it actually is… according to a single image, taken with a limited dynamic range sensor, the processing pipeline behind it and all baked in… Conversely, this is what we consider as “taking a picture”, while what people apparently desire are the results of “making a picture”, enter the smartphones with cameras, no post-editing of single- and multiple- photographs. This begs the question “does the difference described here - taking vs. making - really matter? Most would say NO, while most photographers and enthusiasts hold on to the original single image outlet of a dedicated camera. No matter, the image quality differences re still visible in a way, where I can easily spot images made with a phone, vs. those taken with a camera - conclusively, I’d never take any important image using a phone, too much of a compromise on quality and editing potential…

  • @GatorWinup
    @GatorWinup Před rokem +1

    2 cents: depth of field and Bokeh are two different concepts. Your comparison of portrait mode and the blurry background of the drink picture let me know that you are confused. But I am sure some quick online search would clarify them to you.

  • @FranklinBryan
    @FranklinBryan Před 2 lety +1

    Love your videos. Is that Halcyon at 15:20 ish?

  • @favesongslist
    @favesongslist Před rokem

    Wow that was such a well explained video a#yet again TY.
    Love the ending, What do we "really" want!

    • @cyrileo
      @cyrileo Před rokem

      Thanks for listening! Interesting point, "What do we 'really' want"? 🤔 How about, control over the tech that runs our lives 🤖 (A.I)

  • @saozzie
    @saozzie Před 2 lety

    Excellent, thanks!

  • @Real_Good_Joe
    @Real_Good_Joe Před 2 lety

    You missed a bunch of algorithms, but this is the gist of it, nice video

  • @dfcx1
    @dfcx1 Před rokem +1

    iPhone 13's camera has a large enough physical aperture that the bokeh in close-up photos such as that glass is formed optically. It's not unusual to stop the aperture of a traditional camera's lens down to f/8 and smaller to get useful DOF in macro shots.

  • @SuperExadidas
    @SuperExadidas Před rokem

    Very good presentation.

  • @twogenders
    @twogenders Před 2 lety

    That last line is deep.

  • @aamaya13
    @aamaya13 Před 2 lety

    Very Good. Thank You

  • @MicrophonicFool
    @MicrophonicFool Před rokem +1

    Excellent video as usual. As a photographer/video guy, I am more disturbed by the trend of taking a picture of the moon, or Eiffel tower and have it replace my pixels with those of known images. That practice is unacceptable to Art.

  • @stefankachaunov396
    @stefankachaunov396 Před 2 lety

    That was a great video, thanks! I also found it very curious that you had a picture of my subway station in Sofia, Bulgaria, have you been there?

  • @Bobby_Snoof
    @Bobby_Snoof Před rokem

    Thanks a lot for these explanations !!! I had asked myself this question a lot, as I have an SLR camera, and I was thinking that some pictures looked better taken with a smartphone...I suspected that computer power was involved!

  • @odaialzrigat
    @odaialzrigat Před 2 lety

    Great content 👍