A detailed  introduction to the theory and applications of Augmented Reality and practical design using the Google AR Core platform.

Introduction to the theory and applications of Virtual Reality, its evolution over time, analysis of the engineering challenges, and software and systems design using modern platforms.

Introduction to  the theory and applications of Mixed Reality and the Microsoft Hololens Mixed Reality development platform.

Virtual and Mixed reality user interface design using 5DT Data Gloves.

A detailed analysis of the computational challenges of Mixed Reality systems design.

Mixed Reality (MR) is emerging as a driver of the next big revolution in manufacturing, healthcare, and remote collaboration. The internet is full of articlesand case studies on how MR headsets, such as the Microsoft Hololens and the Magic Leap One, are being used by aerospace companies and hospitals to achieve unprecedented engineering and medical feats. However, MR is much more than the headsets and few of these articles explain how magical experiences can actually be created using off-the-shelf MR hardware. In this series named “How to MR”, we will discuss various computer science challenges that need to be addressed in order to create useful and immersive MR experiences. In the first chapter of this series, we discuss the problem of alignment in MR.

In this chapter, we will discuss the problem of ego-pose estimation. The Latin word “ego” means “self”. Ego-pose estimation is the task of accurately estimating the pose of the MR headset with respect to the world coordinate system. This is absolutely crucial to make sure that virtual objects are rendered accurately and persistently on real-world surfaces/anchors. In this article, we formally describe the task of ego-pose estimation and how object tracking is used to accomplish it. We also present the challenges and the current trend of research in this area.