NeoCam

Overview

Neocam was a beautiful project done in collaboration between many different members from UCA Datalab. It was originally motivated by the first OpenCV AI Competition in 2021, which asked for projects based on the new edge computing camera Oak-D from Luxonis, which has 3 objectives (depth field) and a built-in chip that runs CV models on the device itself.

Our project involved developing a complete edge-cloud platform for real-time monitoring of newborns in neonatal intensive care units. Premature babies require continuous observation, yet much clinically relevant information — such as motor activity, stress indicators, environmental conditions, and subtle behavioral cues — is either assessed subjectively or not captured systematically. By embedding intelligent devices directly at the incubator level, the project enables continuous collection and analysis of multimodal data (video, audio, vital signs, and environmental signals) while preserving privacy and minimizing intrusiveness. The goal is to transform raw, heterogeneous sensor streams into structured clinical information that supports more informed and timely medical decisions.

Technically, the system combines optimized deep learning models deployed on edge devices with cloud-based infrastructure for secure storage, visualization, and integration into hospital workflows. In 3 months a team of 8 researchers developed NeoCam, a device able to measure the baby’s limbs motion, infer emotional status to detect pain and measure breathing rate in a contactless fashion. The whole Proof of Concept, which involved also a cloud platform and a mobile app, was deployed at the Neonate Intensive Care Unit at Hospital Puerta del Mar in Cádiz.

The project won the first regional prize (Europe) in the 2021 OpenCV AI Competition and the second global prize, out of more than 1400 submitted projects. It also led to a publication in the high reputation journal IEEE Journal of Biomedical and Health Informatics.

The PI of this project was my colleague Lionel Cervera. My role was to be responsible for the development of the three AI algorithms that were incorporated into the NeoCam.

Media Coverage

• OpenCV Blog Episode 32 (04/11/21) Real-time tele-monitoring of preterm neonates with NeoCam - Interview with Satya Mallick, CEO of OpenCV. link
• A UCA project wins first place in an international Artificial Intelligence competition, Diario de Cádiz (8/09/21) link

Videos

• Spot: https://www.youtube.com/watch?v=58KHGucW0dQ
• Motion detector: https://www.youtube.com/watch?v=CGLl9O9GtEg
• Breath rate detector: https://www.youtube.com/watch?v=ZsHf2NaaHW8