[OpenCV] Identify and Track Specific Object
Abstract—Augmented Reality (AR) has become increasingly popular in recent years and it has a widespread application prospect. Especially in 2016, Pokémon Go, a location-based augmented reality game, has brought a dramatic impact on the global market of mobile games which has become the milestone of AR technology. AR is a kind of comprehensive application and it allows users to experience digital game play in a real world environment. Although a mature AR product includes various technologies, such as location technique, 3D reconstruction, its core technology is object identification and tracking. In this report, I implement the basic functions of object identification and tracking, then rendering a 2D model overlaying the object in the preview, which achieves the basic effect of Pokémon Go.
Bag of visual words.
In this project, there are three key techniques to implement functions. Firstly, we transform images to SURF descriptors and train these descriptors to get bag of visual words model. Next, we use this model to get the vector representation of object image and justify the validity of homography matrix to identify the object. Finally, after identifying the object, we use optical flow method to track it and overlay 2D model on the frame buffer according to the position of object.
The bag-of-visual-words (BoW) model is a simple assumpti
