Microsoft, IBM, Jefferson Health // Self Health

Skills:  team leadership, user research, ideation, graphic design

Date: November 2015

Tools: Trello, Powerpoint, Photoshop

The Challenge 

Health professionals have limited information on their patients because check-ins are infrequent and during the check-ins patients notoriously have poor recall of day-to-day emotional and physical health. At a weekend-long health hackathon by Jefferson Health I cofounded Self Health, in order to solve this problem. Our team consisted of passionate and talented engineers, designers, business people, and medical students. We designed and prototyped a wearable IoT device & service platform to provide higher quality patient information to health professionals. 

Research Approach

Research consisted of group discussions, prototyping, online reading, and interviewing mentors at Jefferson Health, IBM, and Microsoft. We researched cutting edge psychiatric and psychological mental health assessment tools. Additionally, we researched the efficacy of learning emotional and physical diagnostic information from analysis of voice, blood pressure and heart rate.


Medical: Most mental health assessments can be completed with three inputs of “happy”, “sad”, & “fine” or “yes”, “no”, & “maybe”. Additionally, these assessments often require patients to recall information two weeks prior to their appointment.

Technology: With IBM’s Bluemix and Watson technologies we can translate audio to text, predict mood from voice, identify common journaling keywords, and analyze data in infinite ways.

Business: We are adding value by creating a proactive care connection between patients and doctor. Target customers are Accountable Care Organizations. We must prove to these organizations that the device improves quality of care and thus reduces their costs.

Impact on Prototype

We prototyped a software platform for recording audio journal entries, inscribing the audio with speech to text software, and organizing the data for mental health analysis. The patient’s wearable device interface is shown on a Microsoft Band, but we will also have a low-cost wearable alternative. The physician’s software dashboard displays well-organized and insightful patient information; physicians can reference long-term health trends, as well as specific life events.