Human-Computer Interaction

MARI (Mobile AR-Assistenz in Industrial): Augmented Reality Assistive Systems for Mobile Industrial Application Scenarios

01.05.2017 bis 31.03.2022

Motivation 

The world of work is in a state of upheaval: the digitalization of in- dustry means that simple tasks are no longer necessary, as they are increasingly performed by machines. The remaining activities are be- coming more and more complex. Added to this are the influences of the shortage of skilled workers and demographic change. People must be empowered to keep pace with the growing demands. Augmented Reality (AR) offers an approach to deal with this challenges. AR technologies and concepts have gained traction in recent years; with AR the real world is superimposed with digital objects, e.g. by the use of projections or AR glasses.

Project Goal 

The MARI project investigates how intelligent systems could support people in mastering complex production processes. In particular, the question arises how a portable, intelligent, and modular assistive system can be used for a wide range of activities within small and medium- sized enterprises (SMEs). In addition to the identification of use cases and prototypical implementations of the system, the focus of the project is on the evaluation of the system for various activities in order to gain insights into the interaction between humans and industrial assistance systems.

Reserch Activities 

Within the project, different prototypes are developed and evaluated in the context of a human-centred design process. The implemented systems can support mobile and stationary assembly activities by providing various types of information. In the course of the evaluation, among other things, the extent to which projection-based assistance systems are suitable for training new employees was investigated. In cooperation with the Clausthal University of Technology, a study was conducted with a total of 33 participants, in which it was observed how the participants learned the assembly process over several days with the help of an AR assistance system. Although no advantages were found with regard to the trainingtime,thestudyshowedthat systematic incorrect learning of work steps could be avoided consistently when training with an AR assistance system, since the system’s hand tracking directly detects potential errors and draws the employee’s attention to them. Further activities within the project relate to technical issues, such as the realization of different portable versions of the system or the integration of machine learning methods into the systems for state detection for quality assurance measures.

This project is promoted by:
Bundesministerium für Bildung und Forschung (BMBF)
Sponsors: VDI Technologiezentrum GmbH
Funding Code: 13FH005IX6
Funding Lines: IngenieurNachwuchs 2016 – Kooperative Promotion
Stakeholders / Contacts: Dr.-Ing. Sebastian Büttner
Employees: Dr.-Ing. Sebastian Büttner
Dr.-Ing. Sebastian Büttner, Henrik Mucha, M. Sc., Thomas Kosch, Mario Aehnelt, Dr. Sebastian Robert, Prof. Dr.-Ing. Dr. phil. Dr. rer. soc. Carsten Röcker
The Design Space of Augmented and Virtual Reality Applications for Assistive Environments in Manufacturing: A Visual Approach
In: 10th ACM International Conference on PErvasive Technologies Related to Assistive Environments (PETRA '17), Jun 2017
Dr. Michael Fellmann, Dr. Sebastian Robert, Dr.-Ing. Sebastian Büttner, Henrik Mucha, M. Sc., Prof. Dr.-Ing. Dr. phil. Dr. rer. soc. Carsten Röcker
Towards a Framework for Assistance Systems to Support Work Processes in Smart Factories
In: A. Holzinger P. Kieseberg, A M. Tjoa, E. Weippl (Eds.): Machine Learning and Knowledge Extraction. Proceedings of the International Cross Domain Conference for Machine Learning & Knowledge Extraction (CD-MAKE’17), LNCS 10410. Springer, Heidelberg, Germa, Aug 2017
Dr.-Ing. Sebastian Büttner
Menschzentrierte Dienste in der Fabrik der Zukunft – ein Framework für adaptive projektionsbasierte AR-Assistenz
In: Doktorandenseminar, Mensch und Computer 2017, Sep 2017
Dr.-Ing. Sebastian Büttner, Prof. Dr.-Ing. Michael Prilla, Prof. Dr.-Ing. Dr. phil. Dr. rer. soc. Carsten Röcker
Mobile Projection-Based Augmented Reality in Work Environments – An Exploratory Approach
In: R. Dachselt, G. Weber (Eds.): Mensch und Computer 2018 - Workshopband. Gesellschaft für Informatik, Bonn, Germany, Sep 2018
Intelligent Adaptive Assistance Systems in an Industrial Context – Overview of Use Cases and Features
In: 5. Workshop zu Smart Factories: Mitarbeiter-zentrierte Informationssysteme für die Zusammenarbeit der Zukunft, Mensch und Computer 2018, Sep 2018
Dr.-Ing. Sebastian Büttner, Prof. Dr.-Ing. Michael Prilla, Prof. Dr.-Ing. Dr. phil. Dr. rer. soc. Carsten Röcker
Augmented Reality Training for Industrial Assembly Work – Are Projection-based AR Assistive Systems an Appropriate Tool for Assembly Training?
In: ACM CHI Conference on Human Factors in Computing Systems (CHI 2020), Apr 2020
Teaching by Demonstrating – How Smart Assistive Systems Can Learn from Users
In: 22nd International Conference on Human-Computer Interaction, Jul 2020
Master
Using Deep Learning-Based Action Recognition in Assistance Systems – A Prototypical Implementation
Master
Development of a Prototype for Mobile Remote Collaboration Using Projection-Based Augmented Reality
Project work
Erkennung von Montageschritten durch maschinelles Sehen mit Hilfe von OpenCV
Andreas Peda
Promoted by
Projektträger