ZatLab: programming a framework for gesture recognition and performance interaction

Computer programming is not an easy task, and as with all difficult tasks, it can be faced as tedious, impossible to do, or as a challenge. Therefore, learning to program with a purpose enables that "challenge mindset" and encourages the student to apply himself in overcoming his handicaps and exploring different theories and methods to achieve his goal. This chapter describes the process of programming a framework with the purpose of achieving real time human gesture recognition. Just this is already a good challenge, but the ultimate goal is to enable new ways of Human-Computer Interaction through expressive gestures and to allow a performer the possibility of controlling (with his gestures), in real time, creative artistic events. The chapter starts with a review on human gesture recognition. Then it presents the framework architecture, its main modules, and algorithms. It closes with the description of two artistic applications using the ZatLab framework.