According to a recent publication in Optica, researchers working under Laura Waller at UC Berkeley have developed an “easy-to-build camera that produces 3D images from a single 2D image without any lenses.” The “DiffuserCam” can capture high-definition 3D information in large volume without the use of a scanning mechanism or difficult-to-manufacture micro-circuitry.
But, you ask, How does it work? The magic lies in Waller’s use of “computational imaging,” which is “an approach that examines how hardware and software can be used together to design imaging systems.” In other words, the hardware and software are thought of as two smaller, complementary parts of a holistic imaging system. Despite the DIY approach, the DiffuserCam is no joke, as the camera can reconstruct 100 million voxels (points in 3D space) from an 1.3-megapixel image. As a comparison, the article mentions that the new iPhone X captures 12-megapixel photos. It means that you could use that image sensor to build a a DiffuserCam that captures more than a billion points.
The camera hardware is “essentially a bumpy piece of plastic” that is “placed on top of an image sensor,” a summary article explains. This simplicity makes it versatile and easy to construct. Researchers in Waller’s lab say they can build it using any image sensor, and practically any bumpy piece of plastic, including privacy glass stickers, Scotch tape, and conference pass holders.
The lensless DiffuserCam consists of a diffuser placed in front of a sensor. The system turns a 3D scene into a 2D image on the sensor. After a one-time calibration, an algorithm is used to reconstruct 3D images computationally. The result is a 3D image reconstructed from a single 2D measurement.
This approach enables the researchers to unload the complexity off of the hardware and into the processing algorithms. This proves the old adage that “software eats hardware,” and brings with it one of the classic benefits of code: You only have to make the complex software once, because after that it can be easily copied and distributed.
Waller says her team’s work proves out the usefulness of computational imaging, showing that this holistic approach enables breakthroughs in performance and price that were not possible before. Still, she warns, “this is a very powerful direction for imaging, but requires designers with optical and physics expertise as well as computational knowledge.”