Skip to content

Online platform for medication information, KnowUrMedicine, created by a Mumbai teen, caters to individuals who struggle with reading, detailing its functionality.

Household helper delivers full medicine box to 17-year-old Som Sengupta in Mumbai, saying "You take it, Som," due to inability to comprehend English labels. Incident two years ago led to creation of KnowUrMedicine, a web app aiming to provide drug information in vernacular languages for India's...

Website Created by Mumbai Teen Aids Unliterate Individuals in Accessing Medical Information: A Look...
Website Created by Mumbai Teen Aids Unliterate Individuals in Accessing Medical Information: A Look at Its Functionality

Online platform for medication information, KnowUrMedicine, created by a Mumbai teen, caters to individuals who struggle with reading, detailing its functionality.

In a commendable initiative, 17-year-old Som Sengupta from Mumbai has developed KnowUrMedicine, a web application designed to provide critical medicine information in accessible and understandable formats for India's vernacular-speaking and less literate populations.

The app leverages Optical Character Recognition (OCR) technology to extract text from medicine labels uploaded by users, primarily medicine packaging photos. This text extraction enables the app to detect important medicine information such as dosage instructions and side effects.

Next, an AI model, likely accessed via API, processes and translates this extracted information into vernacular languages like Hindi and Marathi, catering to non-English speakers. Finally, Text-to-Speech (TTS) technology converts the translated text into audio, allowing the medicine information to be played aloud for users who may be less literate or unable to read the text themselves.

The user accesses the app via a QR code or link, chooses a language, uploads a photo, and receives spoken medicine instructions, making medicine information accessible to India's less literate population in their native languages.

Som opted for an off-the-shelf AI translator to keep development lean and ensure accurate translations of technical terms. However, early mistranslations were a challenge, but refining the AI prompts improved precision. Similarly, Som faced a learning curve in mastering FastAPI and AI integration during development.

To enhance accessibility, KnowUrMedicine's interface is simple and mobile-optimized, requiring minimal user input—scan QR code, select language, upload photo—and performing all processing in the cloud without storing user data, enhancing privacy and scalability. The app's cloud-based architecture and QR code model facilitate efficient handling of growing user loads and easy access.

The app's success is evident in its field tests with over 200 customers, where iterative testing and refinement honed the system's accuracy. A study shows 45% of patients misinterpret dosage or frequency without native-language instructions, posing health risks. With KnowUrMedicine, this risk is significantly reduced.

Moreover, 85% of Indians lack English proficiency, and 90% of medicine labels are in English, leading to medication errors for many. KnowUrMedicine aims to bridge this gap by providing medicine information in vernacular languages, ensuring accuracy and accessibility.

Som collaborated with 20+ healthcare professionals and 3-4 chemists for real-world feedback, ensuring the app met practical needs. The app's TTS module, initially sounding robotic, was improved to achieve a conversational tone for users with low literacy. Furthermore, an audio autoplay feature was implemented to eliminate the need for users to press a button for audio playback.

Som's goal is to make the app widely available, envisioning it on medicine bags or at chemist shops. With its innovative use of AI, OCR, and TTS, KnowUrMedicine is poised to revolutionize the way medicine information is accessed and understood in India.

Read also:

Latest