Tiny New Sensor – That Could Fit in a Smartphone – Makes the Invisible Visible


MantiSpectra, a new near-infrared sensor mimicking the Mantis shrimp’s vision is capable of analyzing materials directly without reconstructing spectra. This technology promises applications in health, agriculture, and waste management, potentially even integrating into smartphones for consumer use. Credit: Eindhoven University of Technology

A miniaturized near-infrared sensor that could fit in a smartphone can analyze the chemical content of milk and plastics.

Researchers have developed a new near-infrared sensor inspired by the complex vision of the Mantis shrimp, which contains 16 different sensors on a single chip. This innovation, crafted through a cost-effective wafer-scale fabrication process, simplifies the spectral analysis by eliminating the need for spectral reconstruction, allowing direct analysis of materials like milk and plastics. Anticipated applications include personalized healthcare, precision agriculture, and enhanced recycling processes.

Understanding Vision and Color Perception

The human eye is a marvelous sensor. Using three different types of photoreceptor cone cells that convert visible light into signals for different colors, the eye gives essential information about the world around us.

“When our brain puts the signals together, it makes a prediction of what the signals mean based on our experiences. For example, a red strawberry is sweet, but a green one is not,” explains Kaylee Hakkel, PhD researcher in the Photonics and Semiconductor Nanophysics group at the Department of Applied Physics and co-first author of the study.

Mantis Shrimp Eyes

Mantis shrimp.

Advancements in Spectral Sensing Technology

While the human eye is impressive, it’s far from being the most advanced natural light sensor out there. “The eyes of the Mantis shrimp have 16 different types of cells, which are sensitive to ultraviolet light, visible, and near-infrared (NIR) light,” says Hakkel. “And measuring the spectrum in the infrared is most interesting for applications in industry and agriculture, but there’s one major issue – current near-infrared spectrometers are just too big and expensive.”

Hakkel and her collaborators have solved this issue by developing a near-infrared sensor that fits onto a small chip. And just like the eye of the Mantis shrimp, it’s got 16 different sensors – but they are all sensitive in the near-infrared. “Miniaturization of the sensors while keeping costs low was a major challenge. So, we designed a new wafer-scale fabrication process to achieve this.”

“It’s low-cost because we can produce multiple sensors at the same time, and it’s ready, right now, for use in practical applications in the real world,” Hakkel adds. “The sensor chip is small and could even be embedded in future smartphones.”

MantiSpectra Cross Section

Cross section of the sensor. Credit: Kaylee Hakkel, Eindhoven University of Technology

Streamlining Data Analysis With New Sensors

Andrea Fiore, research lead from the Department of Applied Physics and the Eindhoven Hendrik Casimir Institute, is delighted with their research team’s work. “We’ve been investigating this technology for a number of years. And now we’ve successfully integrated the spectral sensors on a chip, while also dealing with another key issue – efficient use of the data”

Normally, when a sensor measures light, the generated signal is used to reconstruct the optical spectrum – or optical fingerprint – for the material. Sensing algorithms are then used to analyze the data.

In this new approach, the researchers show that the step of spectral reconstruction isn’t needed. In other words, the signals generated by the sensors can be sent straight to the analysis algorithms. “This significantly simplifies the design requirements for the device,” notes Fiore.

Analyzing Milk and Plastics

With the sensor in hand, the researchers then tested the sensor in a number of experiments, as explained by co-first author Maurangelo Petruzzella, who is also working at the startup company MantiSpectra. “We used the sensor to measure the nutritional properties of many materials including milk. Our sensor provided comparable accuracy in the prediction of fat content in milk as conventional spectrometers. And then we used the sensor to classify different types of plastic.”

The nutritional properties of milk determine its economic value, and the sensor has been proven to accurately measure these properties. In addition, these measurements could be used to monitor the cow’s overall health. Classification of plastic types using the sensor can help to optimize waste sorting processes.

“Besides these applications, we anticipate that the sensor could be used for personalized health care, precision agriculture (monitoring the ripeness of fruit and vegetable for instance), process control, and lab-on-chip testing. We now have a full development kit available based on this technology, the SpectraPod™, that companies and research institutes are using to build their applications. And the great thing is that this sensor could even be commonplace in the smartphones of the future meaning that people could use it at home to check the quality of their food or check aspects of their health,” adds Petruzzella.

MantiSpectra Future

And things are just starting to get exciting for Hakkel, who defends her thesis on January 14th at TU/e. Afterward, she’ll be joining Petruzzella at the startup company MantiSpectra where they will strive to advance the sensor for more practical applications.

“I’m really excited to start working on the next phase of the sensor development with MantiSpectra. This sensor could contribute to a cleaner environment and address food waste, applications that are important for everyone.”

Reference: “Integrated near-infrared spectral sensing” by Kaylee D. Hakkel, Maurangelo Petruzzella, Fang Ou, Anne van Klinken, Francesco Pagliano, Tianran Liu, Rene P. J. van Veldhoven and Andrea Fiore, 10 January 2022, Nature Communications.
DOI: 10.1038/s41467-021-27662-1

1 Comment on "Tiny New Sensor – That Could Fit in a Smartphone – Makes the Invisible Visible"

  1. Very Interesting.
    Some thoughts which coud be useful.

    1. Sensors detect.
    2. Visibility is as a reflection from the light from the visible spectrum falling on the object being detected by the Sensors in the eye , being focused on the retina vide the lenses.
    3. Now, reimagine if after detection, we ensure that the object instead of reflecting light absorbs the light 100 percent. Black will absorb all the light which falls on it and depends on the blackness percentage of the object on which light falls. Example Black Hole!
    4. So if on detection of the object we can ensure that none of the light that falls on it gets reflected, but is absorbed or diverted elsewere, then we would have achieved invisibility for the visible spectrum.
    5. Similar invisibility for Infra Red and Ultra Violet Spectrum can be achieved , to create invisibility from all types of detecting devices! The New Radar for the quanum age!

    Views expressed are personal and not binding on anyone.

Leave a comment

Email address is optional. If provided, your email will not be published or shared.