Internet of Augmented Things (IoAT)

Internet of Augmented Things (IoAT) investigates how to bridge physical and digital environments without replacing familiar objects. Using camera-based tracking and projection mapping, the system overlays digital content onto non-digital artifacts, such as wall clocks and paper calendars, and allows users to interact with them using a laser pointer.

In practice, the laser-pointer interaction often proved brittle, especially under low-resolution camera setups, and sometimes disrupted the user’s natural flow. These limitations led me to ask whether we could infer users’ intent implicitly from other signals instead of relying on explicit pointing.

This question became a pivot point in my research trajectory, moving me from purely engineering physical interfaces toward modeling latent mental states through multimodal sensing, such as eye tracking and EEG—a theme that runs through my later VR and gaze-based interaction work.