Dynamical Recurrent Visual Perceiver

Introduction

Real-life applications of computer vision often require high-quality visual sensors. With current technology, such sensors are expensive.

Background

Empirical evidence from our ERC-funded research of biological vision suggests that eye motion enhances recognition capabilities beyond what could be expected if the eye was functioning as a static camera. Motivated by these findings, we aim to perform the major computer vision tasks required for many real-life applications, including segmentation, classification, and identification, with low-resolution cameras.

Methodology

The idea is to use a series of low-resolution frames from a moving camera, rather than using a single high-resolution image. This novel algorithm, termed here DRVis, can be implemented in software or hardware.

Key Features of DRVis

• Unlike existing solutions that use multiple frames to reconstruct a high-resolution image from low-resolution ones, DRVis does not need to learn all the particularities needed for reconstruction.
• Instead, it focuses on extracting the necessary features per the given task.

Project Goals

The goals of the PoC project are to:

1. Scale up and diversify our current software system.
2. Implement the system in hardware.
3. Demonstrate its performance in field conditions.
4. Develop the IPR strategy.
5. Explore the commercialization potential of our solution.

Expected Applications

We expect it will be applicable to a wide spectrum of image processing tasks in settings where sensor quality is low but multiple time samples are available, including:

• Smart agriculture
• Drone navigation
• Visual aid devices