Human-centric sensing applications have rapidly penetrated every facet of our daily lives including child education, elderly support, smart transportation, and automated homes. They have evolved to capture and use a rich set of human activities and internal states (such as intention, engagement, attention, depression) to provide highly usable situational services. For example, an upcoming mobile advertisement application will precisely target customers with the buying intention and send promotions exactly when they are free to look at the coupons. Over the years, I have been working on core challenges to (1) innovate mobile/wearable/IoT systems to enable highly enriched, and available context awareness, (2) design innovative human-centric sensing applications, and (3) deploy the systems and applications to real target users at scale and make them highly usable. In this talk, I will first share key challenges and opportunities in human-centric sensing and analytics with example systems and applications that I have built and deployed. Then, I will introduce two specific systems I have been working on: (1) DeepMon, the mobile deep learning system to enable continuous vision sensing application, and (2) CommBetter, the real-time face-to-face interaction sensing system.
Youngki Lee is an assistant professor in the School of Information Systems at Singapore Management University. He received his Ph.D. from the computer science department in KAIST, Korea, and joined SMU in March 2013. Youngki has broad research interests in building experimental and creative software systems, which involve multi-dimensional considerations across operating systems, applications, and users. More specifically, he has been developing mobile and sensor systems to enable always-available and highlyenriched awareness of human behavior, emotion, and surrounding contexts. Also, he addressed core technical challenges such as improving energy efficiency, handling concurrency, and improving recognition accuracy. Furthermore, he has been building and deploying innovative human-centric sensing applications in various application domains such as daily healthcare, childcare, education in collaboration with domain experts. He published a stream of his work in top-tier conferences and journals such as ACM MobiSys, ACM SenSys, ACM UbiComp, IEEE TMC. More details about him is available at http://youngkilee.blogspot.com.