Manipulação de Objetos 3D em Aplicações de Realidade Aumentada por Meio da Movimentação da Mão

Abstract

The need to make access and manipulation of digital information has made more intuitive with which new technologies emerge. In this respect we can highlight the growth of applications of Virtual and Augmented Reality, which began to demand improvements in methods of interaction used. Thus, this study aims to investigate methods of interaction and develop an augmented reality application that makes use of a more intuitive way of manipulating virtual objects. With the study of the state of the art, it was noted that the use of hands, by positioning and gestures, consists of an intuitive interface and cognitively advantageous for use. Using this information, it was determined that the application to be developed as resources should provide the possibility to interact with virtual objects using their hands without using any apparatus attached to the body, taking into account needs to be compatible with different skin colors skin to ensure use in environments with complex backgrounds (containing various objects and people) with little dependence on illumination. For this, we used the Kinect device together with the OpenNI framework and NITE middleware, which consist of software modules for specific applications with interaction via gestures. The display of the augmented image was carried through the implementation of a module event handling, and rendering operations, which used as a rendering engine the Ogre3D library. Finally, we discussed the development of the application with the proposed requirements, which is to allow interaction in a simplified environment of AR, which allows the creation of virtual objects and their manipulation (rotation, scaling, translation and deletion) via pre-defined gestures and menus.