A Robust, Real-time, and 3D Human Motion Capture System through Multi-Cameras and AI
Real-Move aims to develop a marker-less, real-time 3D human motion tracking system using multi-camera views and AI to enhance workplace safety and ergonomics, reducing costs and improving quality of life.
Projectdetails
Introduction
The ability to reliably track 3D human motion in real-time is crucial for a wide range of applications across various fields, such as healthcare, entertainment, industry, and sports. Occupational ergonomics, as the intersection of industry and healthcare, could particularly benefit from such a solution, as recent reports indicate that physical and cognitive ergonomics issues at work contribute to major economic losses in Europe.
Current Challenges
However, the existing commercial human motion capture (MoCap) systems often exploit multiple markers or inertial measurement units (IMUs). These systems, in addition to their high costs, suffer from many technical and usability issues, including:
- Lengthy set-up times
- Compromised user comfort
- Bothersome wearability needs
- Large drifts and inaccuracies over time in IMU-based Mo-Cap systems
Some of these issues can be dealt with by using vision-based human skeletal trackers. However, they face challenges such as:
- High vulnerability to occlusions
- Missing or inaccurate 3D tracking capacity
These limitations have severely depreciated their reliability for real-world applications.
Market Gap
These challenges leave us with no existing market solutions for marker-less (comfortable), robust, economic, and real-time 3D human motion tracking.
Proposed Solution
Real-Move aims to create such a solution by exploiting multi-camera views and AI algorithms. The system will be capable of:
- Tracking multiple people in the scene with high accuracy
- Providing application-driven data services such as human factors alongside motion tracking data
Innovation Potential
Real-Move has the highest innovation potential to become a key player in the multi-billion Euros MoCap and workplace safety markets.
Socio-Economic Impact
In addition, by providing quick and easy access to vision-based risk monitoring tools, it can make a significant socio-economic impact by improving the quality of life of individuals at work while saving a large amount of money by cutting waste.
Financiële details & Tijdlijn
Financiële details
Subsidiebedrag | € 150.000 |
Totale projectbegroting | € 150.000 |
Tijdlijn
Startdatum | 1-1-2024 |
Einddatum | 30-6-2025 |
Subsidiejaar | 2024 |
Partners & Locaties
Projectpartners
- FONDAZIONE ISTITUTO ITALIANO DI TECNOLOGIApenvoerder
Land(en)
Vergelijkbare projecten binnen European Research Council
Project | Regeling | Bedrag | Jaar | Actie |
---|---|---|---|---|
Learning Digital Humans in MotionThe project aims to enhance immersive telepresence by using natural language to reconstruct and animate photo-realistic digital humans for interactive communication in AR and VR environments. | ERC Starting... | € 1.500.000 | 2025 | Details |
SMARTSENS: Smart wear for sensing the neuromusculoskeletal system during human movement in vivoSMARTSENS aims to revolutionize neuro-rehabilitation by providing a wearable, non-invasive system for continuous monitoring of neuromuscular parameters during daily activities. | ERC Proof of... | € 150.000 | 2023 | Details |
SpatioTemporal Reconstruction of Interacting People for pErceiving SystemsThe project aims to develop robust methods for inferring Human-Object Interactions from natural images/videos, enhancing intelligent systems to assist people in task completion. | ERC Starting... | € 1.500.000 | 2025 | Details |
Forecasting and Preventing Human ErrorsThis project aims to develop AI methods that predict human errors from video data and provide auditory feedback to prevent such errors, ultimately reducing their social and economic costs. | ERC Consolid... | € 1.999.629 | 2022 | Details |
Dynamical Recurrent Visual PerceiverThe project aims to develop DRVis, an algorithm that enhances computer vision tasks using low-resolution frames from moving cameras, targeting applications in smart agriculture and drone navigation. | ERC Proof of... | € 150.000 | 2022 | Details |
Learning Digital Humans in Motion
The project aims to enhance immersive telepresence by using natural language to reconstruct and animate photo-realistic digital humans for interactive communication in AR and VR environments.
SMARTSENS: Smart wear for sensing the neuromusculoskeletal system during human movement in vivo
SMARTSENS aims to revolutionize neuro-rehabilitation by providing a wearable, non-invasive system for continuous monitoring of neuromuscular parameters during daily activities.
SpatioTemporal Reconstruction of Interacting People for pErceiving Systems
The project aims to develop robust methods for inferring Human-Object Interactions from natural images/videos, enhancing intelligent systems to assist people in task completion.
Forecasting and Preventing Human Errors
This project aims to develop AI methods that predict human errors from video data and provide auditory feedback to prevent such errors, ultimately reducing their social and economic costs.
Dynamical Recurrent Visual Perceiver
The project aims to develop DRVis, an algorithm that enhances computer vision tasks using low-resolution frames from moving cameras, targeting applications in smart agriculture and drone navigation.
Vergelijkbare projecten uit andere regelingen
Project | Regeling | Bedrag | Jaar | Actie |
---|---|---|---|---|
HoloCloud MR - toekomst voor de zorgHoloMoves ontwikkelt een Mixed Reality systeem met IoT-integratie om revalidatie te versnellen en zorgverleners inzicht te geven in patiëntbewegingen, met als doel verbeterde zorg op afstand. | Mkb-innovati... | € 20.000 | 2022 | Details |
Virtual Tracking Made EasyManus onderzoekt de haalbaarheid van een gebruiksvriendelijk body tracking systeem met hoge accuraatheid voor de VR-markt. | Mkb-innovati... | € 20.000 | 2024 | Details |
Real-time data voor sport prestatiemanagementHet project ontwikkelt een innovatief product voor real-time data-analyse in de topsport, door nieuwe hardware en software te combineren voor betere prestaties en blessurepreventie. | Mkb-innovati... | € 171.815 | 2019 | Details |
2D naar 3D mapping voor autonome realtime feedback (MARF)360SportsIntelligence en Ludimos ontwikkelen 3D-mapping software voor het tracken van sporters en het genereren van digital twins, gericht op geautomatiseerde training en wedstrijdregistratie. | Mkb-innovati... | € 256.200 | 2023 | Details |
Camera-based, realtime motion tracking van meerdere spelers in active esports omgevingPWXR onderzoekt de haalbaarheid van een camera-based tracking systeem voor actieve VR-exergames, gericht op innovatie en marktpotentieel. | Mkb-innovati... | € 20.000 | 2023 | Details |
HoloCloud MR - toekomst voor de zorg
HoloMoves ontwikkelt een Mixed Reality systeem met IoT-integratie om revalidatie te versnellen en zorgverleners inzicht te geven in patiëntbewegingen, met als doel verbeterde zorg op afstand.
Virtual Tracking Made Easy
Manus onderzoekt de haalbaarheid van een gebruiksvriendelijk body tracking systeem met hoge accuraatheid voor de VR-markt.
Real-time data voor sport prestatiemanagement
Het project ontwikkelt een innovatief product voor real-time data-analyse in de topsport, door nieuwe hardware en software te combineren voor betere prestaties en blessurepreventie.
2D naar 3D mapping voor autonome realtime feedback (MARF)
360SportsIntelligence en Ludimos ontwikkelen 3D-mapping software voor het tracken van sporters en het genereren van digital twins, gericht op geautomatiseerde training en wedstrijdregistratie.
Camera-based, realtime motion tracking van meerdere spelers in active esports omgeving
PWXR onderzoekt de haalbaarheid van een camera-based tracking systeem voor actieve VR-exergames, gericht op innovatie en marktpotentieel.