Suraj Gharde

All projects

WariVerse वारी

Multilingual AI Assistant for Pandharpur Wari Pilgrims

Code on GitHub(opens in new tab)

Key numbers

  • 3 languages: Marathi, Hindi, English
  • 8 tools behind GPT-4o function calling

How it works

  1. 1Input

    A pilgrim asks by chat, voice or the in-app IVR phone line, in Marathi, Hindi or English

  2. 2Transcribe

    Deepgram speech-to-text for voice and calls

  3. 3Act

    GPT-4o function calling across 8 tools, including crowd forecast, routing, facilities, SOS and lost and found. SOS requires human confirmation.

  4. 4Output

    Answers in chat or voice with Marathi text-to-speech, plus a Leaflet crowd map

What I built

  • Designed a 3-language (Marathi, Hindi, English) assistant that answers by chat, voice and an in-app IVR phone line.
  • Integrated GPT-4o function calling across 8 tools (crowd forecast, routing, facilities, SOS, lost and found) alongside Deepgram speech-to-text, Marathi text-to-speech and a Leaflet crowd map; SOS requires human confirmation.

Stack

React Native (Expo), TypeScript, FastAPI, PostgreSQL, Redis, OpenAI GPT-4o

Deepgram, Leaflet

Team and context

Team
Team of 4
Context
Built for a hackathon on the Pilgrim Experience & Temple Management track. The team placed 2nd.