ATK: Air Typing Keyborad

Project Overview

ATK (Air Typing Keyboard) is a novel air-typing system, which enables you to type in the air without wearing extra devices. Leapmotion was set to track fingers, with the tracked points' motion history, we can infer the typing words with an improved Bayes prediction model and language model.
  • 2014.10 - 2015.4
  • Persuasive Computing Group, HCI Lab, Tsinghua University
  • Xin Yi, Chun Yu, Mingrui Zhang, Sida Gao
  • Platform & Device Developer


Ten-finger freehand mid-air typing is a potential solution for post-desktop interaction. However, the absence of tactile feedback as well as the inability to accurately distinguish tapping finger or target keys exists as the major challenge for mid-air typing. Thus we present ATK (Air Typing Keyboard) , a novel interaction technique that enables freehand ten-finger typing in the air based on 3D hand tracking data.


Yi, Xin, Chun Yu, Mingrui Zhang, Sida Gao, Ke Sun, and Yuanchun Shi. "Atk: Enabling ten-finger freehand typing in air based on 3d hand tracking data." In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, pp. 539-548. ACM, 2015. [link]



System overview
Typing process
Software Platform

© Mingrui Zhang. All rights reserved.