Time-of-Flight (ToF) Tips: Tips to Boost 3D Performance and Cut Integration Time & Cost

For demanding real-time object detection, Time-of-Flight (ToF) cameras using Sony’s new IMX556 DepthSense sensor have boosted speed, precision and accuracy but also simplified integration time and cost. To achieve the full potential of Time-of-Flight technology, some key factors should be considered. In this video we'll talk about common challenges with ToF and some tips to help overcome them. Here's a breakdown of the video:
0:00 - Intro
0:36 - LUCID Vision Labs overview
1:03 - How Time of Flight (ToF) calculates 3D depth data
2:16 - Intro to Sony DepthSense ToF sensor (IMX556)
2:51 - Helios 3D ToF camera features
3:20 - Helios Flex camera modules for Jetson TX2 features
3:33 - Distance & accuracy - What is ToF best suited for?
4:21 - Outdoor & indoor lighting
6:45 - Target & camera motion
8:10 - Specular & Non-reflective objects
8:46 - Exposure time & gain, image accumulation, confidence threshold
10:00 - Multipath: object multipath
10:53 - Multipath: surface background multipath
11:52 - Ambiguity (wrap around)
13:15 - Frequency cross-talk interference
14:27 - Additional helpful resources
14:44 - How to contact LUCID
Industrial Machine Vision Cameras thinklucid.com
© LUCID Vision Labs
#MachineVisionCamera #IndustrialCamera #LUCIDVisionLabs #MachineVision #3DVision #ToF

[@randomTake48]

awsome explanation

[@songyop]

This is a very informative presentation!

[@machinevision4341]

Thank you for that lecture it was very interesting, and I'm glad that you showed us real examples instead of theory only

[@LUCIDVisionLabs]

Glad you liked it!

[@ahmadatta66]

just what I needed. Thanks, pretty well explained.

[@LUCIDVisionLabs]

Thanks for watching!

[@GopalDas-qs7kc]

Do you have an example of showing the overlaying of color camera with the TOF camera? I appreciate your input

[@LUCIDVisionLabs]

Here are two 3D models with RGB+3D
sketchfab.com/3d-models/assorted-objects-helios2triton-cameras-73d4ef94789c41e8a99bf40fdbb7b72b
sketchfab.com/3d-models/laundry-detergent-bottles-helios2triton-750769440e8c47edb18995ca1f008feb

[@MacintoshFanTechnology]

Cool

[@trondJohansen-yb4eh]

I need a ToF camera below the 850nm. Why cant i find any product for my application 😔

[@LUCIDVisionLabs]

That's because any VCSELs below 850nm will conflict with many types of indoor lighting and ambient light. 850nm is used because it is outside the visible spectrum. ToF cameras have to filter out ambient light and using a wavelength lower will end up getting filtered too.

[@zombieregime]

Literally everything EXCEPT how a indirect ToF image sensor works..... Direct single point ToF and static point cloud depth sensing make sense to me, but this real time ToF across an entire image frame without capturing frames in the picosecond range, Im completely lost. I though LUCID could help....but I guess I was wrong.... [walks away, sad, in the rain]

[@LUCIDVisionLabs]

There is a delay between the light sending and returning and the camera calculating the point clouds. The delay is around 10 - 12ms.