The Chips That See: Rise of the Image Sensor

Sdílet
Vložit
  • čas přidán 22. 03. 2023
  • Sponsored by Blinkist. Get 25% off Blinkist premium and enjoy 2 memberships for the price of 1! Start your 7-day free trial by clicking on this link: www.blinkist.com/asianometry
    Links:
    - The Asianometry Newsletter: asianometry.com
    - Patreon: / asianometry
    - Twitter: / asianometry

Komentáře • 247

  • @Asianometry
    @Asianometry  Před rokem +19

    Get 25% off Blinkist premium and enjoy 2 memberships for the price of 1! Start your 7-day free trial by clicking on this link: www.blinkist.com/asianometry

    • @donaldharlan3981
      @donaldharlan3981 Před rokem +2

      pictures at 2:35 and 3:00 is heavily shopped. 📺

    • @annoloki
      @annoloki Před rokem

      I am the blinkist! **starts blinking really hard** see?? **blinks even harder** aaarrrrrggghhhhh!!!! My eye lid muscles are massive!

  • @mcmann7149
    @mcmann7149 Před rokem +195

    Image sensors are some of the most interesting parts of digital technology today and something which most people take for granted, especially with how cheap these sensors have become.

    • @ChrisHarmon1
      @ChrisHarmon1 Před rokem +11

      I fly FPV so I definitely appreciate how good they have become. Transmitting HD video only requires 7-8 grams of hardware which can go 30 miles with the right antennas/conditions. Today it's all about latency, weight and image quality. I can't wait to see what the market looks like in 5 to 10 years.

    • @yash_kambli
      @yash_kambli Před rokem +4

      No one take it for a granted infact most people don't even know it's existed.

    • @OlorinEa
      @OlorinEa Před rokem

      They are not digital at all 😅

    • @taiwanluthiers
      @taiwanluthiers Před rokem

      When I was little, and this is in the early 1990s, textbook says that video cameras used vidicon tubes (look up what that is). When I was in high school they started having DV camcorders, not VHS ones or anything. These were fairly small (by the standards of the day) and took very clear videos. In those days a decent camcorder was about 1000 dollars, and the good ones had 3 CCD sensors, one for each color.
      I imagine today camcorders are pretty much a much smaller market, for youtubers or whatever, but most will just be using cell phones. In the early 2000s cell phone cameras were utter shit, it took very grainy images in the best of time. But today their image quality is better than camcorders of the late 1990s.

    • @backgammonbacon
      @backgammonbacon Před 4 měsíci

      @@yash_kambli that's literally what people mean when they say "take it for granted" lol.

  • @douro20
    @douro20 Před rokem +117

    CCDs were once used as high-speed serial memory devices. Tektronix back in the early 1980s produced a digital oscilloscope using CCD memory which could capture up to 500 million samples per second, faster than any other digital oscilloscope at the time.

    • @cogoid
      @cogoid Před rokem +22

      Cool! Also check out Tektronix 7912 from 1970s. It was based on a special scan converter CRT and was capable of recording 512 points in 5 nanoseconds. Very good for digitizing fast transient processes in nuclear physics and other similar applications.

    • @douro20
      @douro20 Před rokem +14

      @@cogoid Yeah I heard about that. They apparently had a trailer full of them to record data for underground nuclear testing.

    • @cogoid
      @cogoid Před rokem +15

      @@douro20 Yes, they were using these digitizers to record the actual course of the chain reaction -- how fast the neutrons multiply in the bomb during the explosion. The main engineering difficulty in this is the enormous dynamic range of the signal. To record the entire transient with good accuracy, they used many different sensors to get good resolution at both the low end and the high end of expected values, with a bunch of digitizers working in parallel.

    • @TimPerfetto
      @TimPerfetto Před rokem

      @@cogoid No I'm not checking out anything you suggest anymore - we both know what happened last time

    • @TimPerfetto
      @TimPerfetto Před rokem

      @@douro20 Heard from who? Please send me their contact info

  • @drwho9437
    @drwho9437 Před rokem +129

    CCDs do not use the photoelectric effect (5:52). The photoelectric effect is when an photon exceeds the workfunction of a surface and creates a free election. Meanwhile CCDs or CMOS image sensors are like solar cells, they create electron-hole pairs in the *bulk* of the crystal. The photon generates an exciton state, which is weakly coupled electron and hole, this exciton is broken in the case of silicon by thermal means and the electron and hole are separated by diffusion or field transport (classic diode transport).

    • @TimPerfetto
      @TimPerfetto Před rokem +4

      OmGgg yessss thank you glad I'm not the only one

    • @elizabethwinsor5140
      @elizabethwinsor5140 Před rokem +5

      Jesus ...you really understand this magic ....I am impressed....

    • @aternias
      @aternias Před rokem +2

      you are a god

    • @defeatSpace
      @defeatSpace Před rokem +4

      It goes both ways 😉
      So yes, the CIA are probably watching you through your displays. Don't even get me started on recording homes in 3D using wifi.

    • @TimPerfetto
      @TimPerfetto Před rokem +3

      @@defeatSpace Oh no now they know I eat my cats hair I am going to burn all my devices

  • @100brsta
    @100brsta Před rokem +90

    You didn’t mention Kodak in CCD producers. They were a long time leader in the field until Sony took over.

    • @TimPerfetto
      @TimPerfetto Před rokem +11

      You didn't mention Sony in CCD producers. They were a long time leader in the field until Sony took over.

    • @milantrcka121
      @milantrcka121 Před rokem +12

      Kodak built the first digital camera. It was decided that digital camera would take away from the extremely lucrative film business...

    • @100brsta
      @100brsta Před rokem +3

      @@milantrcka121 yes that might be true on the consumer field, but Kodak high end CCDs were best performing devices until late 2000s. with the leader I didn't mean in volume, but in performance. I would say somewhere in mid 2000s Sony started to make sensors of similar performance to Kodak (their imaging sensor division got taken over by ON Semiconductor) with CCD performance. Kodak sensors at the time were mostly too expensive for consumer cameras.

    • @milantrcka121
      @milantrcka121 Před rokem +1

      @@ti75425 No conspiracy present or implied. Just a fact supported by history.

    • @milantrcka121
      @milantrcka121 Před rokem +4

      @@100brsta Indeed! Kodak engineering was the best or second to none in many fields especially optics (satellite telescope mirrors) and commercial optics (Instamatic). Also special magnetics and materials. And of course CCDs...

  • @rayoflight62
    @rayoflight62 Před rokem +6

    One thing that should be made clear in the video, is the difference between the photoelectric effect and the photovoltaic effect.
    The photoelectric effect is when a photon knock off an electron from a metal and that electron can conduce a current. This doesn't require a junction and was discovered in 1921. The energy of visible light can knock electron off alkaline metals.
    The photovoltaic effect is when the photon creates a couple {electron - hole} in a doped PN junction. The junction separates the two and creates an electric current.
    The latter is the effect utilised in CCD and CMOS image sensors.

  • @Xiaotian_Guan
    @Xiaotian_Guan Před rokem +35

    The consumer market may have been taken over by CMOS, but for specialty applications like in astronomy and on spacecrafts, CCD still dominates. Big telescopes, on earth or in space, almost all exclusively use CCDs for their superior image quality.
    The smearing issue mentioned at 7:45 is a drawback for consumer products, but is actually a feature for ground observating satellites. It happens because when the charges in one CCD pixel moves to the next pixel, that pixel is still sensitive to light, so the readout process of CCD is essentially like moving the entire sensor across the image field. But on a satellite, if the readout speed of the sensor matches the speed the image of the ground moves across the sensor, you can stabilize the image and get longer integration time for free. The CCD now operates like a scanner, and can churn out an image tens of thousands of pixels long by thousands wide. Many spin stabilized spacecrafts also take advantage of this feature, for example NASA's Juno and ESA's Gaia.

    • @termitreter6545
      @termitreter6545 Před rokem +2

      Thats interesting, especially considering CMOS apparently got partially made viable by NASA.
      Tbf tho, does that mean that CCD are inherently better for big telescopes, or that CMOS hasnt reached full viability for big telescope sensor? Most of the push for CMOS seems to come from commercial and military cameras, which usually rely on smaller, light and efficient sensors. Maybe research lags behind at large scale.

    • @aritakalo8011
      @aritakalo8011 Před rokem +9

      @@termitreter6545 Of note is... Yeah thy studied it and didn't pick it up. Since yes CCD needs more external hardware and so on, but well they quality was better. Specially compared to early CMOS.
      Issue with CMOS is for example heat. Those transistors flipping on the pixel? That generates heat. Not much heat, but enough heat that it matter on highest end scientific use. Since heat means thermal electrons, thermal electrons mean noise. We are talking "we are cooling this in a liquid nitrogen cryogenic devar" levels of "we don't want thermal electrons". As such in that case the "needs external hardware" is benefit, not a hindrance. Needs external hardware? Fantastic, we were anyways planning to separate out as much of the equipment and electronics as far away from the sensor chip as possible to isolate noise.
      Plus those amplifiers on each CMOS pixel? Tiny and packed it tight space. Which again often means more noise. They have gotten better with it, but it is still a game of "trying to stuff lot of tiny amplifiers". CCD? Uses one big main amplifier. Which can be made as perfect as possible with little regards for size.
      That single amplifier brings another benefit. Consistency. One wants the scientific sensor to be flat. not just "look similar" flat, but perfectly flat and linear in response across the pixels. Since one often uses thos pixels for comparative measurements. If one pixels amplifier is little different responding to another, that is problem. Response not linear and predictable. SO again a "problem" of CCD is a benefit in this speciality case. Since one can be sure the amplifier and analog to digital response is same for all pixels. Since there is only one amplifier and ADC circuit.
      However again this isn't mere military or industrial grade situation. They are fine with the little noises and guibles of CMOS. "the picture looks fine" and so on. It works.
      This is "we hunt single photons, if we have 2 photons worth of noise on the pixel, that is a problem". Nobody else would care about 2 photons worth of noise, but big telescope hunting for single photons from another galaxy does care.
      However in CMOS is also used in astronomy, where it's features benefit. For example lucky imaging, which is based on taking lot of images fast and picking best ones regarding atmospheric conditions. Obviously then, a fast reading CMOS is better.
      So it's all about "what is the desired effects" and well for scientific cases sometimes CCDs quirks are benefits. Plus the unbeaten raw quantum efficiency, where CMOS might be "as good as CCD", but in scietific "as good as" is not enough, one wants the best.

    • @pulpufictione
      @pulpufictione Před rokem +2

      ​@@aritakalo8011 Counterpoint: all of the IR focal plane instruments flying on the JWST are CMOS based, in principle. The photosensitive absorber layer is "read out" by a similar (if not exactly the same) as a CMOS pixel amplifier as found in any modern commercial CMOS sensor.
      The LEO satellites that were launched with scanning arrays are "old" in the grand scheme of things. Sure, they work fantastically well, but it can be readily assumed that if it can be replaced by a 2D focal plane, it will. Eventually. Or maybe it already has. Less integration time and more frames can make up for the loss in SNR by averaging.
      Generally, any nonlinearities related to the amplifier can be calibrated out with a dark frame (or Correlated Double Sampling, as mentioned in the video) or by sweeping the reset voltage and checking the output of the amplifier. Yes, it's not convenient to have to perform a calibration, but it's generally good for a while, and it can be done as easily as taking an image (no physical access is required).

    • @harrison00xXx
      @harrison00xXx Před 7 měsíci

      What i have seen so far, at least when it comes to the big telescopes, they have CCD and CMOS instruments, depending on the wavelengths and usecases.
      For visible light CMOS is preferred, not only because of bigger sensor sizes but also because of higher resolution/smaller pixels.

  • @brothergrimaldus3836
    @brothergrimaldus3836 Před rokem +8

    "And because I was tired."
    Understandable, have a nice day.

  • @pcfdvd1
    @pcfdvd1 Před rokem +28

    As someone who majored in astrophysics, this is awesome! Most of the telescopes we used during our labs were CCD based if I'm remembering correctly...

    • @H0mework
      @H0mework Před rokem +6

      Still are from what I'm told. Way more sensitive still.

    • @TimPerfetto
      @TimPerfetto Před rokem

      No

    • @JohnnyWednesday
      @JohnnyWednesday Před 8 měsíci

      Still are - CCDs utterly thrash CMOS for sensitivity - something telescopes require. CCDs are preferred in movie cameras too - rolling shutter from CMOS can ruin an action scene.

  • @michaelmoorrees3585
    @michaelmoorrees3585 Před rokem +13

    There's a simpler cousin to the photomultiplier tube. A simple phototube, which works similarly, but does not have the intermediate "dynodes". Their most common use was to sample the audio soundtrack, on old movie film, and convert it to a voltage. The soundtrack was a strip next to the image fields, which would block more or less light, according to the recorded audio level. The light source was fairly bright, so a photomultiplier was not required.
    Photomultipliers were, and still are, used in mostly scientific instruments. There was one consumer app, from the 1950s, where GM had several high end car models with actively dimming headlights. The photomultiplier was used to know when to momentarily power off the high beams, reducing the light going to the oncoming car. It was called the Autronic-Eye.

  • @giszTube
    @giszTube Před rokem +21

    I could swear Kodak was involved in the early days of CCDs on satellites.

  • @DimbleWally
    @DimbleWally Před rokem +6

    10/10 on the Albert Einstein joke reference. 🤣

  • @fredinit
    @fredinit Před rokem +14

    Jon, another excellent essay. Next in the imaging category... Stacked image sensors similar to the Foveon. Initial patents on the technology have or are about to run out. Newer process nodes that have a better understanding on how to stack components, along with more sophisticated image processing software and hardware portend this to be the next 'big thing'

  • @punditgi
    @punditgi Před rokem +9

    Many thanks for taking on this topic! 😊

  • @DEtchells
    @DEtchells Před rokem +38

    Wow, how the *heck* do you manage to do the research your vids require, and still work a day job?! Just incredible content!
    I was in the consumer imaging business for many years (still am, on a semi-retired basis). My understanding of what really killed off CCDs in consumer cameras was HD video. CCD image quality at the time was markedly superior, but you couldn’t clock them fast enough to do HD video on higher-resolution chips. You could clock data off a ~3 megapixel CCD chip fast enough to one way or another end up with VGA video, but as chips got bigger with more pixels CCDs couldn’t keep up.
    It might have been more the power required for such fast readout rather than the absolute maximum clock speed; I just remember from talking with camera company engineers at the time that it was HD video that was the death knell.
    I remember being chagrined at the sharp drop in image quality that happened as a result; as you said, the noise was the problem and became particularly evident at higher ISO (light sensitivity) levels.
    Another fantastic video, thanks!
    (My one criticism: As someone else noted below, it’s not actually the photoelectric effect that’s at work, it’s that photons make hole-electron pairs, the same phenomenon that drives solar cells. Rather than turning the energy into a continuous output current though, sensor pixels simply collect the charge in the potential wells of diode structures. - Hence, photodiodes :-)

    • @MithunOnTheNet
      @MithunOnTheNet Před rokem +1

      He has a team of researchers helping him out.

  • @Soosss
    @Soosss Před rokem +20

    This channel is an absolute gold mine, thank you for all the work you do!

  • @makerspace533
    @makerspace533 Před rokem +3

    When I think of bubble memory, I think of the non-volatile magnetic memory promoted by TI and others in the 1970's. The development of winchester disks and CMOS memory put the bubble memory to bed. I remember at TI we were also attempting to develop CCD imaging. The problem was that the metal layer on top of the device made it difficult to make the collection area for each pixel as large as it could be. So a technique of sandblasting the back of the chip so thin that light could come through the backside of the chip. Today we talk mostly about the successful ideas, but there was a lot of effort put into those ideas that never made it.

  • @dnbeuf72
    @dnbeuf72 Před rokem +4

    Great video! Worked 20 years of my life on CCD’s. Seen its rise and decline.
    Very well told!

  • @WolfmanDude
    @WolfmanDude Před rokem +3

    Photomultiplier tubes are still a current technology, there is no modern replacement for those. Its basically the only kind of vacuum tube thats still beeing produced in large volumes for serious applications (Aside from magnetrons).

  • @stefanmarraccini8646
    @stefanmarraccini8646 Před 3 měsíci +1

    I suggest an episode focused solely on Canon's CMOS achievements. They committed to the technology early and produced superior results across digicam market segments.
    Thanks for your series!

  • @TheJamieRamone
    @TheJamieRamone Před rokem +4

    Photodiodes make use of the PHOTOVOLTAIC EFFECT, not the photoelectric effect. Only alkali metals (sodium, potassium, etc) have a very low energy threshold within the visible light spectrum. The photovoltaic effect doesn't knock out the electrons, but moves them to the valence band. From there the doping of the silicon works its magic attracting them towards one pole while being repelled from the other.

    • @HailAzathoth
      @HailAzathoth Před rokem +2

      Exactly lol. PE effect is the ejection of electrons above the vacuum level into free space.

    • @Fulcanelli88
      @Fulcanelli88 Před rokem

      In, Ga, Pb...

  • @dilipdas5777
    @dilipdas5777 Před rokem +2

    Photoelectric effect was actually used in Vidicon camera in 1920s

  • @Sunbro123
    @Sunbro123 Před rokem +4

    Just a minor issue, but when talking about the shutter of a camera in front of the sensor you are actually showing the aperture blades of a lens which are not the same thing.

    • @gus473
      @gus473 Před rokem

      Thanks, was going to note same. 😎✌️

  • @-gg8342
    @-gg8342 Před 3 měsíci

    I learned about image sensors in radiology school. You did an exceptional job describing the technologies!

  • @coolandsmartrr
    @coolandsmartrr Před rokem +4

    Very good episode! I've always wanted to see your take on imaging technology, and you've presented a good history on it.
    I would love to see this continued into subjects like:
    - Sony's history with imaging technology
    - How cinema camera makers (e.g. ARRI, Red, Blackmagic) sources their imaging sensors
    -- IIRC, Blackmagic seems to source their sensor from ON Semi, which you mentioned in this episode
    -- Furthermore, their popular Pocket Cinema Camera is so small that their circuitry overlaps, introducing noise. They counter by implementing noise cancellation features

  • @AABB-px8lc
    @AABB-px8lc Před rokem +3

    Sadly no mention of BSI and dual gain, 2 tricks that actually make CMOS wipe CCD even in low light w/o active cooling. And ARRI ALEXA sensor clever trick that not only measure charge, but also time untill capacitor get full (oversatureted ) that make even more information and dynamic range that surpass even analog cinema film.

    • @gus473
      @gus473 Před rokem

      Charge injection device 🤔

  • @bborkzilla
    @bborkzilla Před rokem +2

    Kodak also made CCDs and sourced them for camera manufacturers like Leica and Olympus.

  • @JohnDobak
    @JohnDobak Před rokem +4

    An interesting offshoot of these chips is the impending IR / night vision CMOS revolution. T-Rex Arms did a video showing how much clarity you can get from a typical DSLR camera when you remove the IR filter and film at night. Unless there are export/sales restrictions every American militiaman will have access to night vision rivaling the army's new IVAS / ENVG-B. Your phone's camera's will take better night vision photos too.

    • @Krzysztof_z_Bagien
      @Krzysztof_z_Bagien Před rokem

      CMOS sensors are still not sensitive enough to replace night vision devices, and their sensitivity in near IR is not so great either. So, even if you have a modern, monochrome CMOS sensor without any IR filters whatsoever, even fairly old and cheap night vision tube can still beat it in low light conditions, if you want real-time image at least, and don't want to use external IR light source. That's from my experience, I have IMX462 based astro camera, which is highly sensitive to IR (one of the most IR sensitive consumer chips today), and an old British night vision tube (P8079HP) and that tube is clearly better.
      However, if you use longer exposures (eg. 1s), then camera can produce much better and image, though it's not that much useful for real time observation (moving objects would get smeared etc.).
      We're not quite there yet, but not far away. There are some specialised sensors that can have great performance in (very) low light setting (eg. EMCCD), but they are quite expensive and mostly used for serious science. "Normal" NVG, even those high-end, would still probably be much cheaper.

  • @DerekWoolverton
    @DerekWoolverton Před rokem +11

    First a quick note, Caltech does not capitalize the T, even though it seems like its an abbreviation. Second, also wanted to mention the obscure sensor technology from Foveon that tried to use multi-layered image diodes to capture different wavelengths without a filter. Unfortunately it was complicated enough to fabricate that they could not easily ride process scaling to produce better and better chips, though they still struggle on as part of Sigma and promise they'll have their next generation sensor out any day now.

    • @willow_1
      @willow_1 Před rokem +3

      The sensitivity of the Foveon sensor was also not great - they rely on different wavelengths being able to penetrate different depths into the sensor - red being able to penetrate the deepest. However if the red bit isn't strong enough it doesn't get detected in the red layer and can cause issues...
      Basically they just thought it's not a worthwhile tradeoff for most applications, especially when demosaicing have been refined to the point that it's good enough and cheap enough to do for 99% of colour applications.
      Still a fan of mono sensors though!

  • @archie4oz
    @archie4oz Před rokem +2

    1:18 Ben Thompson says "hi" 😂
    16:40 it also helped that those fabs that used to make CPUs and GPUs for the PS2 and PS3 transitioned into making CMOS sensors.

  • @hobbykip
    @hobbykip Před rokem +3

    Good video. The reason CCDs are still here is the fact they are global shutter by design. CMOS needs another storage node for that making the pixel even more complex requiring also more space. With BSI technology and deep trench isolation they are able to make such small pixels with good dynamic range and sensitivity.

    • @-szega
      @-szega Před rokem

      Literally the same is true for GS CCDs as well, no free lunch.

  • @tigertiger1699
    @tigertiger1699 Před rokem +1

    Really tip my hat to the scientists and developers that had strength of stomach and grit to risk their years and fortunes on these gambles..🙏

  • @JoshuaC923
    @JoshuaC923 Před rokem +3

    As a hobby photographer, this is fascinating. Great work as always! Hope you got enough rest

  • @andersjjensen
    @andersjjensen Před rokem +2

    Photo CCD. Not to be confused with AMD's CCDs which are Core Complex Dies.

  • @richleyden6839
    @richleyden6839 Před rokem +1

    I'm all in on imaging. Thanks for this episode.

  • @SprocketHoles
    @SprocketHoles Před rokem +2

    A really interesting imaging tech is the fovean sensor. Its based on how far light of different energy penetrate into silicon.

    • @hobbykip
      @hobbykip Před rokem

      Sure is but try to manage crosstalk between the colors. I think that makes this technology way too expensive or unusable.

  • @squeezedoz
    @squeezedoz Před rokem +2

    Love you channel and videos, was hoping for bit more fundamental explanation of function of CCD, CMOS and improvements in function over generations. Still great topic.

  • @naniyo0
    @naniyo0 Před rokem +1

    thanks for the video as always. I am a complete amateur in digital sensor tech, but i read that the latest jet fighter F-35 has an EOTS system that is capable to see and target something that is 50km+ away of the size of a suitcase. I bet that is sensor tech to its extreme (at least by today's standard). I wonder who are the companies that possess these state of the art sensor tech, and how far behind are US's competitor.
    I also read that there are three primary types of chip tech these days: logic chip, memory chip, and sensor chip. I always wanna know which type of chip is the most difficult to develop, and in what way. I bet memory chip is the easiest one to crack, but am unsure whether logic chip or sensor chip is more difficult to advance in the long run. 🙏

  • @rayoflight62
    @rayoflight62 Před rokem

    Thank you for this video on image sensors, it is very appreciated.
    Greetings,
    Anthony

  • @emmerad
    @emmerad Před rokem +1

    I would love to see a video about thermal imaging

  • @timng9104
    @timng9104 Před rokem

    seeing how the CCD transfer data, opposed to crossbar AM arrays, it reminded me of racetrack memory. racetrack memory stores information using electron spins. a correlated electron spin gives you low resistance path, and opposing electron spin gives high resistance path. then you can use spin-orbital coupling, apply current, transfer spin, etc... take a look if interested :P

  • @DanielSMatthews
    @DanielSMatthews Před rokem +3

    There is a lot more room for advances in this area, imagine a single photon detector on top of each column of a 3D memory so that the photons were counted digitally at each pixel as they came in. The next step beyond that is to bin the counts by photon energy level, colour. Then you have every single pixel as sensitive as possible and acting as a spectrometer.

    • @brodriguez11000
      @brodriguez11000 Před rokem

      Better light traps inspired by photosynthesis.

    • @DanielSMatthews
      @DanielSMatthews Před rokem +1

      @@brodriguez11000 The quantum of light required in photosynthesis is 8 photons. The ideal system is superconducting nanowires, that exists now, but the superconducting part would be hard, in a consumer device.

    • @Xiaotian_Guan
      @Xiaotian_Guan Před rokem

      There's a limit on how far we can push sensor technologies. QE on modern sensors is already very high, the noise at high gain(high ISO) is already dominated by shot noise, the discrete nature of light. But SPAD based sensors would be a huge step up for dynamic range, as we are no longer limited by each pixel's well capacity. But unfortunately I don't think reading out the energy of the incoming photon is something that can be done with current semiconductor technologies? Maybe some 'quantum' sensors can do that? Idk

    • @HailAzathoth
      @HailAzathoth Před rokem

      That ain't gonna happen lmao

    • @DanielSMatthews
      @DanielSMatthews Před rokem

      @@HailAzathoth I don't know, the individual parts already exist, why specifically do you think that they can't be integrated in the future?

  • @DelfinoGarza77
    @DelfinoGarza77 Před rokem

    I was just thinking about this last week....perfect.

  • @Luis-qe8el
    @Luis-qe8el Před rokem +2

    Just had to drop a merci beaucoup, for the amazing content once more, im always looking forward for some nuts and bolts approach that i feel on this topics that this guy has, 🙏

  • @pizzablender
    @pizzablender Před rokem +1

    I remember "bubble" as magnetic memory. CCD was called a "bucket brigade device" at the time, and could be used as analogue delay line.

    • @tapewolf
      @tapewolf Před 10 měsíci

      BBD chips are still used to produce echo and especially chorus effects for guitars and synths. While this could be done digitally, analogue synths and effects have become fashionable enough that BBD chips are back in production.

  • @AnthonyMuscio
    @AnthonyMuscio Před rokem +2

    I understood CCD was primarily used for Astronomy and have the advantage of allowing extended exposure times, with less noise, I think the term "light bucket" was used for this. As in the video says also for non-visible light. As CMOS improves it has also started being used in Astronomy. I wonder how this related to Infrared cameras?

    • @tookitogo
      @tookitogo Před rokem +1

      All silicon devices are inherently sensitive to light, especially infrared. Both CCD and CMOS image sensors are very sensitive to infrared. In normal visible-light cameras, we use IR-blocking filters (visible at 7:00, it is the pale blue glass window of the sensor module). In pure infrared cameras, we use visible-light-blocking filters (conceptually similar to the purplish-black infrared windows on many remote controls and the devices they control).
      UV is a different matter: Silicon tends not to be particularly sensitive to it, so they have to deliberately design them for it. (Together with the choice of lens materials, since many common types of glass and optical plastic tend to block UV.)

  • @kevinroche7433
    @kevinroche7433 Před rokem

    Thank you for an interesting video. I worked on CCDs, using them as analogue data storage in 1972 and found out the hard way that they were light sensitive as my test circuits failed when the sun came out. I haven't had a cause to use them since. Though I did have a Nokia N95 phone for a while. I always wondered why they were being replaced by CMOS.

  • @ferencvalenta2005
    @ferencvalenta2005 Před rokem +1

    Ehh... PMT's are not imaging devices, you meant camera tubes like Vidicon. CID sensors were completely skipped. CDS was originally used for CCD to get rid of the reset noise. EMCCD, that is basically a solid state, imaging PMT was also missed. Kodak and their transparent gate technology, SITe and their early back-illuminated CCDs (that were used on space probes), Foveon and LBCAST sensors were all missed. And is there a CMOS sensor with ADC in each pixel? There are ones with ADC in every row, is all. Many, many interesting technical details and historycal events ignored or incorrectly presented.

  • @valeriopreite7573
    @valeriopreite7573 Před rokem

    I believe that it's more appropriate to speak of photovoltaic rather than photoelectric effect in this case, as electrons aren't ejected from the material, but promoted from valence to conduction band.

  • @bluegecko6770
    @bluegecko6770 Před rokem

    Thanks so much that I was unaware of

  • @RobSchofield
    @RobSchofield Před rokem

    Great explanation, thanks!

  • @Falcrist
    @Falcrist Před rokem

    10:14
    Turn transistors 2 and 5 off, and turn transistor 7 on. Electrons flow in to charge the capacitor (3) negatively.
    Now turn transistor 7 off, and transistor 2 on. Light hitting the photodiode (1) will allow some electrons to go to ground... reducing the charge.
    Now turn transistor 2 off and transistor 5 on. Assuming transistor 4 is properly configured, electrons will flow through it in proportion to the voltage at the gate (which is the voltage in the capacitor). That current is what's being read by the ADC and converted to a subpixel.

  • @maxheadrom3088
    @maxheadrom3088 Před rokem

    The thing on 7:50 is the aperture mechanism - not the shutter. The shutter on most DSLRs are made of two flaps - one that opens and another that closes. On very old cameras it's a blade with a hole that lets light in for the desired by mathing the hole with the camera's permanent hole - that usually had a small lens of glass in front of it. (Old means first half of the 20th century)

  • @michaelproust7891
    @michaelproust7891 Před 11 měsíci

    Thank you for the clear information.

  • @maxheadrom3088
    @maxheadrom3088 Před rokem

    I like how the show a woman using a vacuum cleaner while she listens to their digests! I really want it! That silent vacuum cleaner, I mean.

  • @JohnnyWednesday
    @JohnnyWednesday Před 8 měsíci

    It's worth noting that CCDs are essential for telescopes and they're vastly preferred in movie cameras as they aren't subject to rolling shutter.

    • @matthewsmith5104
      @matthewsmith5104 Před 3 měsíci +1

      There are global shutter CMOS chips and have been for several years now. CMOS has basically taken over the amateur astrophotography market as well because of superior noise characteristics - all my astronomy cameras have been CMOS. CCDs still have some relevance for scientific purposes (I think?) but CCDs are kind of dinosaur tech at the amateur level.

  • @onkcuf
    @onkcuf Před rokem

    Wow. Super cool to Learn. I'm old. I remember full size camcorders and even 3 ccd cams.

  • @LoFiAxolotl
    @LoFiAxolotl Před 6 měsíci

    Kinda interesting that right now CCD Sensors are seeing somewhat of a resurgence, big problem still being the amount of energy needed... while CMOS Sensors have hit a wall

  • @samnieves8158
    @samnieves8158 Před rokem

    Thank you for taking on such a difficult subject. Optics are a rabbit hole.

  • @haberdasherrykr8886
    @haberdasherrykr8886 Před rokem +1

    Yeah finally drones "coverage" baby!

  • @GriftyMcPants
    @GriftyMcPants Před rokem

    I appreciate your channel. Thanks!

  • @zachjones6944
    @zachjones6944 Před rokem

    Perfect timing. I'm currently working on a digital camera for a large telescope.

  • @murdercom998
    @murdercom998 Před rokem

    I was doing some reading on the Henschel Hs 117 surface to air missle and noticed its detonation system used (detonated by acoustic and photoelectric proximity fuses) I suspect they may have used a early photomultiplier tube but I need to do more research.

  • @ruperterskin2117
    @ruperterskin2117 Před rokem

    Cool. Thanks for sharing.

  • @mailson
    @mailson Před rokem

    15:42 You said “own version of Moore’s Law” at the same time I got a tweet notification informing the passing of Gordon Moore 😢
    The odds.

  • @alphar9539
    @alphar9539 Před rokem

    You are an absolute champion of the people for providing such accurate and useful information in a way that normal working class individuals can understand.

  • @PrajjalakChattopadhyay

    Two wrong information I found:
    1. 2:13 this diagram is not related to the photoelectric effect. This is Hertz's other experiment that proved the existence of electromagnetic waves.
    2. You mentioned that the PMTs have 5 to 7 dynodes. Actually it may have many more. 10, 12 dynode PMTs are easily available. We use 12 stage PMTs in our lab.

  • @value8035
    @value8035 Před rokem +1

    What do you think abut the Dynamic Vision Sensors? (Event cameras)

  • @GetOffMyyLawn
    @GetOffMyyLawn Před 5 měsíci

    Eric Fossum is still active on the DPReview Photographic Science and Technology discussion group... he has many interesting threads about his research.

  • @devrim-oguz
    @devrim-oguz Před rokem

    The CCDs are still used in scientific machines where they cool them down to absolute zero to mitigate thermal noise.

  • @billykorando6820
    @billykorando6820 Před rokem

    Lol you really got to do an appropriate “that X?… Albert Einstein” joke 😂

  • @sachinz4199
    @sachinz4199 Před rokem

    Could you do a video on CQDs (Colloidal quantum dots ) and SPAD (single-photon avalanche diode) also how's the potential of such technology to replace CMOS?

  • @liaminwales
    @liaminwales Před rokem

    Always hoped the Foveon sensor got used more, kind of interesting to see a third player.

  • @LordPecka
    @LordPecka Před rokem +1

    I wonder why do the manafacturers not use some form of 3D layering (perhaps like the AMD is using for their 3D V Cache?) to get the benefit of 100% coverage by photo layer.
    Seems so obvious - and with massive potential benefits - so I have to assume it must be hellishly hard to manafacture.

    • @H0mework
      @H0mework Před rokem +1

      Sony has been doing it recently, about 2 years. December 16, 2021
      Sony Develops World’s First*1 Stacked CMOS Image Sensor Technology
      with 2-Layer Transistor Pixel
      Widens Dynamic Range and Reduces Noise by
      Approximately Doubling*2 Saturation Signal Level*3

  • @code-inc
    @code-inc Před rokem +1

    Please Make an episode about phased array radar and qam modulation

  • @CEEPMDEE
    @CEEPMDEE Před 8 měsíci

    I happily, recently acquired a used Phase One IQ 280 digital back & XF body. I chose that over the Fujifilm GFX 100 II. I already have the Sony a7rIV... which is close enough to the GFX camera.

  • @mercster
    @mercster Před rokem

    The g in 'Hughes' is silent. Thanks for the video.

  • @olavisau
    @olavisau Před rokem

    Can you do a video on the new m3p battery that catl is producing?

  • @kbejustervesenet7261
    @kbejustervesenet7261 Před rokem

    I remember Photobit. I applied for a job with them in end of the 1990's after I finished my Masters. They had their offices near the University of Oslo, Blindern in Oslo, Norway (I didn't get the job though...)

  • @Allan_aka_RocKITEman
    @Allan_aka_RocKITEman Před 11 měsíci

    @Asianometry >>> *_"NOISE is BAD."_*
    Me, who spent MANY YEARS working on and around {and LOVES} gas turbine-powered aircraft:
    NO LIES DETECTED...😉
    {YES, I understand the video refers to ELECTRONIC NOISE...😊}

  • @Siggmasta
    @Siggmasta Před rokem

    Amazing, I love your Videos! What about a sequel about Single Photon Avalanche Diodes (SPAD), which are also CMOS compatible, could play a role in interesting applications are also also making their way into the consumer market (canon, Sony)..

  • @fensoxx
    @fensoxx Před rokem +1

    This is such a great channel. You might drop the Asian focused byline and just do tech wordwide (which you mostly seem to do). You are really good at it. Thanks!

  • @BobDiaz123
    @BobDiaz123 Před rokem

    CCDs are a current based technology, whereas CMOS is a voltage based technology. As the resolution increases, the heat from the current required for CCDs increases. This became a real problem for professional video camera makers in the early days of HD. The increased resolution of HD made the smaller CCD chips impossible because of the excess heat. While CMOS was a possible solution, the rolling shutter effect of CMOS was disliked by professional video producers. Because this was the only solution to shooting HD on smaller chips, it took time for the professional video market to accept this limitation.

  • @Quazgaa
    @Quazgaa Před rokem

    This makes me think of how in computer rendering you need to average many samples together per pixel to create a reasonable-quality image that isn't a steamy pile of garbage. If this was done at the hardware level in image sensors, I bet that would be awesome.

  • @EdPin_
    @EdPin_ Před rokem

    10:13 😁
    Why would i need Blinkist, when i got you...

  • @TmoneyProductions
    @TmoneyProductions Před rokem

    Humans technological advancement is based upon how many transistors we can fit on a chip

  • @altebander2767
    @altebander2767 Před rokem +1

    I'm sorry, but you are confusing bubble memory, which works by having segments of magnetic fields on the material and CCDs which use charges. CCDs have, BTW been used well into the 1980s for storage devices.

  • @pierrecambou3228
    @pierrecambou3228 Před rokem

    Modern CMOS image sensors (CIS) have solved the fill factor issue by using Back Side Illumination (BSI) circa 2010 then this approach led to Stacking (2 layer semiconductor) circa 2015 and now triple stack is being expected as the big news of iphone release 2023, all this 3D semiconductor approach is specific to CIS but has much wider implications, such as memory stacking, this could be another story covered by this wonderfull chanel

  • @scienceandmathHandle
    @scienceandmathHandle Před rokem

    I would argue that even today CCDs are far better sensors than CMOS, and their "Shutter" can be done electronically as well. This because the electrons on a back side illuminated CCD have to migrate toward the wells by an applied electric field. The big reason why CMOS has "mostly" replaced CCDs is that it is more conducive with the fact that most modern microchips use CMOS technology in their design, and thus it is easier to manufacture, for most fabs. Almost all modern astronomy cameras still use CCD technology as they have better dynamic range, higher quantum efficiency and lower noise. In the last few years I used a modern industrial CCD camera could still out perform almost any other CMOS camera in terms of low light and high QE for a particular application.

  • @phil20_20
    @phil20_20 Před rokem +1

    This is how the machines will become self-aware! 😮😢

  • @bruceli9094
    @bruceli9094 Před rokem +1

    Please make video on America's recent breakthrough in Quantum computing and ChatGPT!

  • @SarahBoyd1
    @SarahBoyd1 Před rokem

    “And now it is time for me to explain how this accursed thing works”. 😂

  • @aternias
    @aternias Před rokem

    CCDs were known to have a bloom when objects were bright

  • @jamesjensen5000
    @jamesjensen5000 Před rokem

    If the sensor is basically capturing photons to displace electrons into wells why doesn’t it charge the battery? Does the amplifier drain the charge in excess of additional charge? Maybe the capture process can power the amplifier before the signal is transmitted to the decoder…

  • @feraudyh
    @feraudyh Před 2 měsíci +1

    Alumni is the plural form of alumnus.

  • @soufmaro502
    @soufmaro502 Před 9 měsíci

    the more a global shutter/parallel shift registers registers/synchronous adding/progressing makes sence

  • @defeatSpace
    @defeatSpace Před rokem +1

    Today I learned the CIA can probably spy on me using only my monitor.

  • @wylnd
    @wylnd Před rokem

    I'm just greatly annoyed that image intensifiers or electron multiplication haven't become mainstream yet. The concept is somewhat simple, take photons, make electrons out of them, multiply the electrons, convert back to more photons. With how long night vision is around, it's very odd that it's still so niche and expensive

  • @maxheadrom3088
    @maxheadrom3088 Před rokem

    NASA needed something simpler, faster and cheaper so Lockheed-Martin proposed the F35!

  • @saleemullah7495
    @saleemullah7495 Před rokem

    one suggestion from my side is that channel profile image should be related to content posted on channel............