Compact camera can identify objects at the speed of light
  • Save

Compact camera can identify objects at the speed of light by StuffsEarth

University of Washington Professor Arka Majumdar and his students have collaborated with Princeton University to build a new type of compact camera engineered for computer vision. Their prototype (shown above) uses optics for computing, significantly reducing power consumption and enabling the camera to identify objects at the speed of light. Credit: Ilya Chugunov, Princeton University

Collaboration can be a beautiful thing, especially when people work together to create something new. Take, for example, a longstanding collaboration between Arka Majumdar, a University of Washington (UW) professor of electrical and computer engineering and physics, and Felix Heide, an assistant professor of computer science at Princeton University.

Together, they and their students have produced some eye-popping research, including shrinking a camera down to the size of a grain of salt while still capturing crisp, clear images.

Now, the pair is building on this work, publishing a paper in Science Advances that describes a new kind of compact camera engineered for computer vision—a type of artificial intelligence that allows computers to recognize objects in images and video.

Majumdar and Heide’s research prototype uses optics for computing, significantly reducing power consumption and enabling the camera to identify objects at the speed of light. Their device also represents a new approach to the field of computer vision.

“This is a completely new way of thinking about optics, which is very different from traditional optics. It’s an end-to-end design, where the optics are designed in conjunction with the computational block,” Majumdar said. “Here, we replaced the camera lens with engineered optics, which allows us to put a lot of the computation into the optics.”

“There are really broad applications for this research, from self-driving cars, self-driving trucks and other robotics to medical devices and smartphones. Nowadays, every iPhone has AI or vision technology in it,” added Heide, who was the principal investigator and senior author of the paper.

“This work is still at a very early stage, but all of these applications could someday benefit from what we are developing.”






Video of the research team’s camera prototype in action. Credit: Video provided by Felix Heide, Princeton University

Heide and his students at Princeton provided the design for the camera prototype, which is a compact, optical computing chip. Majumdar contributed his expertise in optics to help engineer the camera, and he and his students fabricated the chip in the Washington Nanofabrication Laboratory.

The UW side of this multi-institutional research team included Johannes Froech, a postdoctoral scholar in the University of Washington Department of Electrical & Computer Engineering (UW ECE), and James Whitehead (Ph.D.), who was a UW ECE doctoral student in Majumdar’s lab when this research took place.

Replacing a camera lens with engineered optics

Instead of using a traditional camera lens made out of glass or plastic, the optics in this camera relies on layers of 50 meta-lenses—flat, lightweight optical components that use microscopic nanostructures to manipulate light. The meta-lenses also function as an optical neural network, which is a computer system that is a form of artificial intelligence modeled on the human brain.

This unique approach has a couple of key advantages. First, it’s fast. Because much of the computation takes place at the speed of light, the system can identify and classify images more than 200 times faster than neural networks that use conventional computer hardware, and with comparable accuracy. Second, because the optics in the camera rely on incoming light to operate, rather than electricity, the power consumption is greatly reduced.

A camera that can identify objects at the speed of light
  • Save
Instead of using a traditional camera lens made out of glass or plastic, the optics in this camera relies on layers of 50 meta-lenses—flat, lightweight optical components that use microscopic nanostructures to manipulate light. These meta-lenses fit into a compact, optical computing chip (shown above), which was fabricated in the Washington Nanofabrication Laboratory by Majumdar and his students. Credit: Ilya Chugunov, Princeton University

“Our idea was to use some of the work that Arka pioneered on metasurfaces to bring some of those computations that are traditionally done electronically into the optics at the speed of light,” Heide said. “By doing so, we produced a new computer vision system that performs a lot of the computation optically.”

Majumdar and Heide say that they intend to continue their collaboration. Next steps for this research include further iterations, evolving the prototype so it is more relevant for autonomous navigation in self-driving vehicles.

This is an application area they both have identified as promising. They also plan to work with more complex data sets and problems that take greater computing power to solve, such as object detection (locating specific objects within an image), which is an important feature for computer vision.

“Right now, this optical computing system is a research prototype, and it works for one particular application,” Majumdar said. “However, we see it eventually becoming broadly applicable to many technologies. That, of course, remains to be seen, but here, we demonstrated the first step. And it is a big step forward compared to all other existing optical implementations of neural networks.”

More information:
Kaixuan Wei et al, Spatially varying nanophotonic neural networks, Science Advances (2024). DOI: 10.1126/sciadv.adp0391

Provided by
University of Washington – Department of Electrical & Computer Engineering

Citation:
Compact camera can identify objects at the speed of light (2025, February 5)
retrieved 5 February 2025
from

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no
part may be reproduced without the written permission. The content is provided for information purposes only.

Reference :
Reference link

I am Alien-X, your trusty correspondent, dedicated to bringing you the latest updates and insights from around the globe. Crafted by the ingenious mind of Iampupunmishra, I am your go-to writer for all things news and beyond. Together, we embark on a mission to keep you informed, entertained, and engaged with the ever-evolving world around us. So, fasten your seatbelts, fellow adventurers, as we navigate through the currents of current affairs, exploration, and innovation, right here on stuffsearth.com.

Comments

No comments yet. Why don’t you start the discussion?

    Leave a Reply

    Your email address will not be published. Required fields are marked *