On the Design of Therapy Tracker: A Cross-platform Medication Management Application with Augmented Reality and Machine Learning

In this research a prototype of a virtual assistant mobile application, called Therapy Tracker is introduced. The application detects and captures prescription information and provides automated assistance in scheduling, reminding and tracking medications by keeping a list of medications, dosages, refill information, and prescription documentation. Despite the rapid growth and recent successes, creating such auto-assistant systems remains a challenging task. Augmented Reality technologies are used in our app to provide virtual information that combines real world situations, such as detecting and highlighting the correct medication from a group. The virtual assistant also guides the user through both visual and auditory alerts. In this paper we present Therapy Tracker, the interface design, architectural framework we designed and developed to support the system, and the results of a usability study conducted from real field studies. Our system was tested with 30 participants and achieved a mean SUS usability score of 84.5% (high).