Insurance AI Hackathon: Award-Winning RAG Assistant

Insurance AI Hackathon: Award-Winning RAG Assistant

A 2nd-place 48-hour proof-of-concept for a Generative AI assistant that helps insurance agents find complex policy information instantly. The same RAG architecture is what I deploy on Azure AI Search + Azure OpenAI for production engagements at Witivio.

Project details

Industry

Insurance

Timeline

48 Hours

Tech Stack

RAG Architecture, multimodal LLM (hackathon prototype on Vertex AI; production target: Azure OpenAI + Azure AI Search)

The Challenge: Information Overload for Insurance Agents

Insurance agents face a significant challenge: navigating vast and complex policy documents to find specific information for clients. This process is often time-consuming, inefficient, and can lead to inconsistent answers. During a fast-paced 48-hour AI hackathon, our team was challenged to build an innovative solution to address this critical pain point for a major insurance provider.

The Solution: An AI-Powered Agent Assistant

Our solution was a Proof of Concept (POC) for a sophisticated AI assistant, built on the cloud platform provided by the hackathon host. The assistant provides a simple conversational interface where an agent can ask complex questions in natural language (e.g., 'What is the coverage for water damage in a basement for policy number 12345?') and receive an instant, accurate, and source-cited answer. The architecture (vector search + RAG + multimodal LLM) is platform-portable: in production engagements, I deliver the same pattern on Azure AI Search + Azure OpenAI with Microsoft Entra identity, private networking, and the compliance posture insurance carriers require.

A dynamic scene from an AI hackathon featuring three professional men in conversation. The central figure, seen from behind, wears a navy sweater vest over a crisp white shirt. Facing him is a man in a white t-shirt and glasses, holding a blue lanyard and looking focused. In the background, a third man smiles warmly. A large digital display shows the text "Let's accelerate! Let's ignite the spark!" alongside a friendly red robot graphic and a Google Imagen-3 credit.

Design & Development Process

Working under intense time pressure, our cross-functional team adopted a rapid, agile approach. We started with a design thinking session to deeply understand the user's (the insurance agent's) needs. We then moved quickly to prototype the conversational flow and build the backend. The process involved setting up a secure knowledge base with sample policy documents and fine-tuning the LLM system prompt to ensure precise and trustworthy responses, crucial for a regulated industry like insurance.

Key Features & Functionality

  • Natural Language Queries: Allows agents to ask questions conversationally, just as they would to a human expert.
  • Context-Aware Responses: A frontier-class LLM understands the nuances of insurance jargon and provides contextually relevant answers.
  • Source-Cited Information: Every answer is backed by a direct reference to the source policy document, ensuring auditability and trust.
  • Multi-Language Support: The POC was designed to be multilingual (French, English, German) to support a diverse agent workforce.

Results & Outcome

Our project was a resounding success, earning our team second place at the hackathon. The POC effectively demonstrated a significant potential for ROI by drastically reducing the time agents spend searching for information, thereby increasing their capacity to serve clients. The judges were particularly impressed with the solution's accuracy, its focus on explainability (citing sources), and its immediate applicability to a real-world business problem.

A group of five diverse professionals, four men and one woman, are captured in a moment of high-energy celebration during an AI hackathon. They are all wearing matching white t-shirts with red branding and blue lanyards with ID badges. Their expressions are joyful, with wide smiles and cheers. They are gesturing with thumbs-up and rock-on hand signs against a clean white background, with a digital screen partially visible on the right.

Lessons Learned

The hackathon was an incredible learning experience. It highlighted the power of Generative AI to solve complex enterprise challenges when grounded in a specific, high-value use case. We also learned the importance of rapid iteration and the critical need for robust system prompting to ensure the AI operates within safe and reliable boundaries, especially in a compliance-heavy environment.