Gwanghyung Lee, Dongkyoo Shin, Dongil Shin, Journal of Internet Computing and Services, Vol. 15, No. 3, pp. 11-20, Jun. 2014
10.7472/jksii.2014.15.3.11, Full Text:  HTML
Keywords: NUI/NUX Framework, Hand Mouse, Kinect

Abstract

The natural user interface/experience (NUI/NUX) is used for the natural motion interface without using device or tool such as mice, keyboards, pens and markers. Up to now, typical motion recognition methods used markers to receive coordinate input values of each marker as relative data and to store each coordinate value into the database. But, to recognize accurate motion, more markers are needed and much time is taken in attaching makers and processing the data. Also, as NUI/NUX framework being developed except for the most important intuition, problems for use arise and are forced for users to learn many NUI/NUX framework usages. To compensate for this problem in this paper, we didn't use markers and implemented for anyone to handle it. Also, we designed multi-modal NUI/NUX framework controlling voice, body motion, and facial expression simultaneously, and proposed a new algorithm of mouse operation by recognizing intuitive hand gesture and mapping it on the monitor. We implement it for user to handle the "hand mouse" operation easily and intuitively.

Statistics
Cite this article