Institute fml
Search        Contact Us        Credits         German german

Pick-by-Vision

Picking supported by augmented reality

 

Aim

The aim of the project is the user-optimal supply of information using data glasses to be carried by the order picker, which displays all relevant data for the correct execution of the picking task depending on place, time, field of view and the status of the order. The novel picking system shall enable intuitive and freehand work, adjusted optimally to the user concerning ergonomic and labor scientific aspects, have a simple communication interface to enter data by the order picker, be easy to learn its application and fulfill the demands in an industrial environment.

Augmented Reality technology

Augmented reality (AR) is a sub-area of virtual reality. AR is the superimposition resp. extension of human perception by computer-generated virtual information. In most cases, only the visual sense is addressed, as the user is supplied with information in context in his field of vision i.e. at the right time at the right place. The real and virtual world are combined in such a way that the user interprets the newly created three-dimensional environment as a unit and can interact with it in real-time. The virtual objects serve as additional information not perceptible by human senses, so that the user can better conduct his real work task.

/fml/images/Ausstattung/AR/milgram_641.jpg

 

The AR technology offers a multitude of fields of application ranging from military applications, medical technology or architecture to industry e.g. quality management, construction of prototypes, service and maintenance or assembly. In logistics there are also interesting fields of application. One of them is picking.

Approach

At the beginning of the project, possible application scenarios and effects on the picking process as well as the resulting demands of an augmented reality supported commission system were systematically worked out. Pick-by-vision is especially suitable for conventional picking systems according to the man-to goods principle, but also for the picking along a row shelf or at stationary picking workplaces. The picking process as such does not change in contrast to other voucherless picking systems. After these basic investigations the selection of the most important hardware and software components is conducted. In the case of the data glasses, the decisive man-machine interface for user acceptance, a monocular virtual retinal display which projects the picture with a weak laser directly onto the retina proved to be the best solution. Language control or a turning button or one to press are used as interactive devices. A tracking system is necessary which records the position and the looking direction of the user, so that the virtual information is displayed in the correct position in space. For the application in picking optical procedures, which can possibly combined with an intertialtracker, are especially suitable. Concerning software a warehouse management system and AR software of the project partners are used.

After the selection of the suitable hardware and software components, a user interface is designed especially for the selected cases of application. This can be understood as the depiction using data glasses and the quantity of the information presented to the order picker and the interactive possibilities of the user with the system e.g. for the acknowledgement of taking out an article. Together with CIM GmbH, a first function model without the use of a tracking system was developed using these results. Thereby information is only presented in text form. The interaction occurs by voice input. For man language is the most natural form of passing on information and he or she has both hands free for the actual task. This first function pattern was repeatedly evaluated and optimized iteratively. The evaluations were conducted in the experimental hall of the chair fml and a distribution center of Kühne+Nagel (AG & Co.)KG. Using an MTM analysis, a theoretical observation of the pick-by-vision system compared to a paper list and a pick-by-voice system was conducted. Together with the subject area for augmented reality (FAR) of the TU of Munich, a second function pattern was implemented using an optical tracking system and with a turning button and button to push. In several pre-investigations in the laboratory, different virtual 3D geometries for finding the way and to support the grabbing motion were tested. After the porting of the system into the experimental hall of the chair fml, again there was an evaluation with a subject program.

Pick-by-Vision

 

Potentials

In the series of experiments both function patterns showed potential to improve the picking. Especially the picking error rate was reduced by a strict leading of the process and the blending in of data into the field of view of the user. If virtual geometries directly highlight the storage area the mental effort is slight and the error rate is low, as no description of the storage area in text form must be transported from the medium supplying information to the real environment. Compared with a paper list but also a simple pick-by-voice-system, the picking times were slightly lower. The reason for this was that the paper list was not handled and there was no sequential give-out of the information. The difference is not significant, but in the case of pick-by-voice, there is a very steep learning curve. Aside from the logistical key  figures, the subjective strain of the subjects was determined. The subjects hardly uttered any complaints, liked to work with pick-by-vision in a  motivated way. All series of experiments only encompassed a short wearing of the data glasses, so that further and longer ongoing investigations are necessary.

Videos

 


 

 


 





 

Final report (German only)

Günthner, W. A., Blomeyer, N., Reif, R., Schedlbauer, M.:
Pick-by-Vision: Augmented Reality unterstützte Kommissionierung
(Pick-by-vision: Picking supported by augmented reality)
Final report, Research project (AiF-FV-Nr. 14756 N)  was funded from resources of the Federal Ministry for economics and via the work committee of industrial research association ""Otto von Guericke"" e.V. (AiF) , February 2009
 pdf -Dokument

 

This research project was conducted by the order of the Federal Association Logistics e.V. and funded from resources of the Federal Ministry for economics and technology via the work committee of industrial research associations "Otto von Guericke" e.V. (AiF).

 

(back)

 

Contact 

Chair fml
Technical University of Munich
Boltzmannstraße 15
D-85748 Garching

 

/fml/images/Umschlag.JPG Contact

 

Funding

 

/fml/images/Forschung/BMWi_web.jpg
  

 

Project sponsor

/fml/images/Forschung/Drittmittel/AIFLogo.jpg


FV 14756 N/1

 

Research association

/fml/images/Forschung/logo_bvl.gif
 

Project partners

  • metaio GmbH
  • CIM GmbH
  • Ludwig Meister GmbH & Co. KG
  • Kühne+Nagel (AG & Co.) KG
  • Avon Cosmetics GmbH
  • Keller und Kalmbach GmbH
    (Keller and Kalmbach GmbH)
  • Jungheinrich AG
  • Adolf Würth GmbH & Co KG
  • LCALL Logistik Consulting Allgayer
    (Logistics Consulting Allgayer)
  • Miebach Consulting GmbH
  • MTU Aero Engines GmbH & Co. KG
  • Hörmann Logistik GmbH
    (Hörmann Logistics GmbH)
  • SEP Logistik AG
    (SEP Logistics AG)
  • VW AG
  • And many more.

In cooperation with the subject area for augmented reality of the TUM.

 

Publications

  • Abschlussbericht
    Günthner, W. A., Blomeyer, N., Reif, R., Schedlbauer, M.:
    Pick-by-Vision: Augmented Reality unterstützte Kommissionierung
    Abschlussbericht, Forschungsvorhaben (AiF-FV-Nr. 14756 N) ist aus Mitteln des Bundesministeriums für Wirtschaft und über die Arbeitsgemeinschaft industrieller Forschungsvereinigungen ""Otto von Guericke"" e.V. (AiF) gefördert worden, Februar 2009
     pdf -Dokument
  • Reif, R.; Günthner, W. A.:
    Untersuchungen zu Datenbrillen bei Kommissioniertätigkeiten
    In: GfA (Hrsg.): Arbeit, Beschäftigungsfähigkeit und Produktivität im 21. Jahrhundert. Dortmund: GfA-Press, 2009.
  • Reif, R.; Günthner, W.A.; Schwerdtfeger, B.; Klinker, G.:
    Pick-by-Vision comes on Age: Evaluation of an Augmented Reality supported Picking System in a real Storage Environment.
    Tagungsband Afrigraph 2009, 04.-06.02.2009, Pretoria, Südafrika.
  • Reif, R.; Günthner, W. A.:
    Pick-by-Vision: An Augmented Reality supported Picking System
    Tagungsband zur WSCG 2009, 02.-05.02.2009, Pilsen, Tschechien.
  • Reif, R.; Günthner, W. A.
    Pick-by-Vision auf dem Weg in die Praxis
    Logistik für Unternehmen 11/12-2008, S. 62-65
  • Reif, R.; Walch, D.; Günthner, W. A.
    Evaluierung eines Augmented Reality unterstützten Kommissioniersystems
    In: Schenk, M. (Hrsg.): "Virtual Reality und Augmented Reality zum Planen, Testen und Betreiben technischer Systeme" VR und AR – Automotive. Magdeburg: Fraunhofer IFF, 2008,  S. 251-260
  • Schwerdtfeger, B.; Reif, R.; Frimor, T.; Klinker, G.
    Neue Techniken zur Informationsbereitstellung in der Kommissionierung
    In: Günthner, W. A.. (Hrsg.): Neue Wege in der Automobillogistik. Berlin: Springer, 2007, S. 487-500
  • Reif, R.; Walch, D.
    Augmented & Virtual Reality Applications in the Field of Logistics
    Tagungsband der 4. Intuition International Conference and Workshop, 04.-05.10.2007, Athen, Griechenland, S. 61-69
  • Reif, R.; Walch, D.; Wulz, J.
    Einsatz von Virtual und Augmented Reality: Studie zur menschorientierten Simulation und Prozessunterstützung im logistischen Umfeld
    Studie aus dem Bayerischen Forschungsverbund Supra-adaptive Logistiksysteme (ForLog), August 2007
  • Günthner W. A., Alt T., Reif R., Schedlbauer M.:
    Er kam, sah und pickte"
    "Logistik heute, Ausgabe 3/2006, S. 54