Module 4 · Session 14 · 90 min · ChatGPT Lab

Session 14: Generative AI in Insurance

CILO-2, CILO-3 · Analytics & Solution Design · Lab-based, Hands-on (ChatGPT) · ChatGPT/LLM account required

Learning Objectives

1. The GenAI Landscape and LLMs

Generative AI represents a fundamental shift in what machines can do with language. Unlike previous AI models that classified or predicted, generative models create — they produce text, summaries, code, analysis, and conversation that is often indistinguishable from human output. For insurance — an industry built on language (policies, terms, conditions, claims, regulations, correspondence) — this capability has profound implications.

1.1 What Are Large Language Models?

An LLM is a neural network trained on a vast corpus of text — trillions of words from books, articles, websites, code repositories, and documents. Through training, the model learns statistical patterns in language: which words follow which other words, how concepts relate, and what constitutes a coherent paragraph, explanation, or argument. When you give an LLM a prompt, it predicts the most likely continuation of that text — one token at a time — generating a response that is statistically plausible based on its training data.

This "next token prediction" mechanism has two critical implications for insurance use:

1.2 The Major Models and Their Insurance Capabilities

ModelProviderStrengths for InsuranceKey Limitation
GPT-4 / GPT-4oOpenAI (ChatGPT)Strong reasoning, broad insurance knowledge (policy types, regulations, terminology), excellent at summarisation and structured output. Supports vision (photo analysis).Knowledge cutoff limits awareness of recent regulatory changes. Can be confidently wrong on Indian-specific insurance regulations.
Claude 3.5/4AnthropicVery strong at following complex instructions, longer context window (100K+ tokens — can process an entire insurance policy). Good at structured JSON output.Training data may have less Indian insurance content than GPT. More cautious — may decline to answer questions it could safely handle.
GeminiGoogleStrong multimodal capabilities (video, images, text). Integration with Google ecosystem (Looker, Search, Workspace).Less specialised in insurance domain knowledge compared to GPT. Enterprise adoption in Indian insurance is lower.
Llama / Open-source ModelsMeta / CommunityCan be fine-tuned on proprietary insurance data and hosted on-premise — critical for insurers with data privacy constraints.Smaller models have less capability. Fine-tuning requires ML expertise and significant compute. Not plug-and-play.
Warning: Never input personally identifiable information (PII) or confidential policyholder data into a public LLM interface (ChatGPT, Claude.ai, Gemini). The data may be used for model training and could be exposed in responses to other users. For insurance use cases involving customer data, use enterprise versions with data privacy guarantees (e.g., ChatGPT Enterprise, AWS Bedrock, or self-hosted open-source models) or anonymise all data before input. A single data privacy violation under the DPDP Act can result in penalties of up to ₹250 crore.

2. Prompt Engineering for Insurance

Prompt engineering is the practice of designing inputs to LLMs to produce reliable, accurate, and useful outputs. In insurance, where the cost of a wrong answer can be measured in crores, prompt engineering is not a nice-to-have — it is the difference between a useful assistant and a liability. The following four patterns cover 90% of insurance use cases.

2.1 The Four Essential Prompt Patterns

Pattern 1 — Role-Based Prompt: Define a specific professional role and context before asking the question. The model tailors its response to the role's knowledge and communication style.

You are a Senior Insurance Underwriter at a general insurance company in India.
You have 15 years of experience underwriting motor, health, and property insurance.
You are training a new junior underwriter.

The junior asks you:
"What are the top 5 risk factors to check when underwriting a private car insurance policy in India?"

Please provide your answer as a numbered list with a brief explanation of each factor and
why it matters for the loss ratio. Use simple language suitable for a junior underwriter.

Pattern 2 — Few-Shot Prompt: Provide examples of the desired input-output format before asking the model to process new input. Essential for extracting structured data from unstructured text.

Extract structured claim information from the following customer descriptions.

Example 1:
Input: "My car was hit from behind at the signal near Andheri station yesterday evening around 6 PM. The bumper is damaged and the left tail light is broken. The other driver admitted fault and his insurance details are attached."
Output:
  Claim Type: Motor — Third Party
  Damage Location: Rear bumper, Left tail light
  Fault: Other driver (admitted)
  Location: Andheri station, Mumbai
  Time: Evening (~6 PM)
  Documents Needed: Police FIR, Other driver insurance details, Photos of damage

Example 2:
Input: "I slipped and fell in my bathroom this morning. I think I might have fractured my wrist. I'm going to the hospital now. I have had this health insurance policy for 2 years."
Output:
  Claim Type: Health — Accident
  Nature of Injury: Possible wrist fracture (undiagnosed)
  Location: Home (bathroom)
  Urgency: Immediate (on the way to hospital)
  Documents Needed: Hospital admission papers, Doctor's report, X-ray reports, Policy card

Now process the following:
Input: "Someone broke into my house last night while we were sleeping. They took my wife's jewellery worth about 3 lakhs and my laptop. I have a home insurance policy but I'm not sure if theft is covered. Please help."
Output:

Pattern 3 — Chain-of-Thought Prompt: Ask the model to show its reasoning step by step before giving a final answer. Reduces errors on multi-step insurance calculations and regulatory analysis.

An insurance company has the following financial data for the year:
— Gross Written Premium: ₹500 crore
— Reinsurance Ceded: ₹75 crore
— Claims Paid: ₹320 crore
— Change in Outstanding Claims Reserve: +₹15 crore
— Operating Expenses: ₹120 crore
— Investment Income: ₹40 crore

Step-by-step, calculate:
1. Net Written Premium
2. Net Earned Premium (assume change in UPR = 5% of NWP)
3. Incurred Claims
4. Loss Ratio
5. Expense Ratio (use GWP as the denominator for expense ratio)
6. Combined Ratio
7. Underwriting Result
8. Profit Before Tax

Show each step with the calculation before moving to the next step.
After all calculations, provide a one-paragraph assessment of the company's financial health.

Pattern 4 — Structured Output Prompt: Request output in a specific format (JSON, table, XML) for programmatic consumption or easy transcription.

Analyse the following IRDAI regulation and produce a structured summary in JSON format with these exact keys:

{
  "regulation_name": "Full name of the regulation",
  "effective_date": "When it came into effect",
  "key_requirements": ["List of 3-5 key requirements"],
  "affected_stakeholders": ["Who is affected — insurers, intermediaries, customers"],
  "penalty_for_noncompliance": "Description of penalties",
  "impact_on_insurtech": "One-sentence summary of what this means for InsurTech startups"

  Regulation text: [Paste IRDAI circular or regulation text here]

2.2 Prompt Engineering Guidelines for Insurance

💡
Pro Tip: The single most effective prompt engineering technique for insurance is: add a verification step to your prompt. Instead of asking the model to produce information, ask it to produce information AND then verify its own output against its training knowledge. Example: "First, generate the policy summary. Then, review your summary and identify any statements you are not fully confident about. Mark those with [NEEDS VERIFICATION]. Finally, for each marked statement, suggest the specific source document or regulation the reader should check." This two-pass approach catches many hallucinations before they reach the customer.

3. Insurance Chatbot Design

A well-designed insurance chatbot is not a "chatbot" — it is a conversational interface to a carefully bounded set of capabilities, with clear guardrails for when to escalate to a human. The most common failure of insurance chatbots is not that they answer badly — it is that they answer confidently beyond their scope, making promises the insurer cannot keep or giving incorrect coverage advice that creates legal liability.

3.1 The Architecture of an Insurance Chatbot

┌─────────────────────────────────────────────────────────────────────┐
│                    INSURANCE CHATBOT ARCHITECTURE                    │
├─────────────────────────────────────────────────────────────────────┤
│                                                                     │
│  USER INPUT (Text or Voice)                                        │
│         │                                                           │
│         ▼                                                           │
│  1. CLASSIFICATION                                                  │
│     ┌─────────────────────────────────────────────────────┐         │
│     │ What type of query is this?                         │         │
│     │ • Policy Inquiry → Route to Policy QA               │         │
│     │ • Claim Status → Route to Claim Lookup              │         │
│     │ • New Purchase → Route to Quote Engine              │         │
│     │ • Complaint → Route to Human (immediate escalation) │         │
│     │ • Complex/Unclear → Route to Human                  │         │
│     └─────────────────────────────────────────────────────┘         │
│         │                                                           │
│         ▼                                                           │
│  2. KNOWLEDGE RETRIEVAL (RAG)                                       │
│     ┌─────────────────────────────────────────────────────┐         │
│     │ • Retrieve relevant policy clauses from vector DB    │         │
│     │ • Retrieve FAQ answers from approved document store  │         │
│     │ • NEVER generate coverage answers from model memory  │         │
│     │ • Only answer based on retrieved documents           │         │
│     └─────────────────────────────────────────────────────┘         │
│         │                                                           │
│         ▼                                                           │
│  3. RESPONSE GENERATION                                             │
│     ┌─────────────────────────────────────────────────────┐         │
│     │ • Use LLM to compose response from retrieved docs    │         │
│     │ • Include policy clause references in the response   │         │
│     │ • Add disclaimers: "This is a general explanation."  │         │
│     │ • If uncertain → "I need to connect you to a human." │         │
│     │ • Log every response for audit and quality review    │         │
│     └─────────────────────────────────────────────────────┘         │
│                                                                     │
│  ESCALATION TRIGGERS:                                               │
│  • Customer expresses dissatisfaction or anger                      │
│  • Query involves a coverage denial or claim rejection              │
│  • Query involves a legal dispute or potential litigation           │
│  • Customer uses words like "lawyer", "ombudsman", "complaint"      │
│  • LLM confidence score below threshold                             │
│  • Customer asks the same question 3+ times (indicates frustration) │
└─────────────────────────────────────────────────────────────────────┘

3.2 The System Prompt for an Insurance Chatbot

The system prompt is the foundational instruction that defines the chatbot's behaviour, scope, and limits. It is the single most important piece of prompt engineering for production chatbots.

SYSTEM PROMPT — INSURANCE CUSTOMER SERVICE CHATBOT

You are "Suraksha", a customer service assistant for SecureSure General Insurance,
an Indian general insurance company offering motor, health, property, and travel insurance.

YOUR CAPABILITIES:
1. Answer questions about policy coverage based on provided policy documents only.
2. Check claim status when the customer provides their claim ID.
3. Explain insurance terms and processes in simple Hindi and English (Hinglish).
4. Guide customers through the claims process step-by-step.
5. Provide information about SecureSure's products (general descriptions, not personalised quotes).

YOUR LIMITATIONS (NEVER DO THESE):
1. NEVER provide a coverage decision ("Is this covered?") without quoting the specific policy clause.
2. NEVER promise a specific claim payment amount or timeline.
3. NEVER make up policy terms or coverage details.
4. NEVER share customer data with anyone without verification.
5. NEVER express frustration or impatience with the customer — always be respectful and helpful.

ESCALATION RULES:
If the customer:
- Asks about a claim rejection or coverage denial → Say: "I understand this is important. Let me connect you with a claims specialist who can review your situation in detail."
- Expresses anger or frustration → Say: "I'm sorry you're experiencing this. Let me connect you with a supervisor who can help resolve your concern."
- Uses legal language ("lawsuit", "ombudsman", "lawyer") → Say: "I recognise this is a serious matter. I will immediately connect you with our customer relations team."
- Repeats the same question 3+ times → Say: "I want to make sure you get the right help. Let me connect you with a team member who can assist further."

Always respond in the language the customer uses. If they use Hinglish, respond in Hinglish.
If they use English, respond in English. If they use Hindi, respond in Hindi.

Begin every response by acknowledging the customer's concern before answering.
End every response by asking if there is anything else you can help with.

3.3 Testing the Chatbot — Five Scenarios

Before any insurance chatbot goes live, it must be tested against a standardised set of scenarios covering the most common customer interactions. Here are five essential test scenarios:

ScenarioCustomer QueryExpected Bot ResponseEdge Case
1. Policy Coverage — Simple"Does my motor policy cover engine damage from waterlogging?"Quotes the specific policy clause on water damage. Explains if it is covered or not, or if it requires an add-on.If the policy document does not explicitly mention waterlogging, the bot must say "Your policy document is not clear on this specific point. Let me connect you with a claims specialist."
2. Claim Status"I filed a claim 5 days ago for my car accident. Claim ID is CLM-2024-8743. What is the status?"Retrieves the claim status from the system. Explains the current stage and expected next step. Provides estimated timeline.If claim ID does not exist: "I cannot find a claim with that ID. Please check the ID on your claim acknowledgement email or call our helpline."
3. Claim Denial — Emotional"You rejected my health claim! I've been paying premiums for 3 years and now you won't pay! This is unfair!"Does NOT argue or defend the rejection. Acknowledges frustration. Explains the right to appeal. Escalates to human specialist.Bot must NOT say "I understand your frustration" if the rejection is clearly wrong per policy terms — it should escalate.
4. Premium Inquiry"How much will my motor insurance renewal be next month?"Explains that premium depends on multiple factors. Can provide last year's premium as reference but cannot quote the exact renewal amount. Suggests the customer check the renewal notice or speak to an agent.Must not generate a specific renewal quote. Premium generation requires the underwriting engine, not the chatbot.
5. Complex Multi-Part Query"I had an accident. My car is damaged and I also have a health insurance policy. Can I claim on both? What documents do I need? How long will it take?"Addresses each part separately. Explains that motor and health are separate policies with separate claims. Provides document checklist. Gives general timeline. Escalates if the customer seems confused.This type of query is where hybrid bots fail — they may combine motor and health processes incorrectly. Each answer must reference the correct policy type.
💡
Illustrative Scenario (hypothetical, for teaching purposes): An insurer deploys a GenAI chatbot for policy Q&A and reduces call-centre volume by ~35% within 3 months by handling ~60% of queries end-to-end. The key to the programme's success is relentless scope discipline: the chatbot is NOT allowed to answer questions involving actual claim amounts, coverage denials, or personalised advice, and every response links to the specific policy clause. This is a constructed teaching example of the scope-discipline design principle, not a reported Indian insurer case.

4. Policy Document Q&A & Summarization

Insurance policies are famously long, dense, and difficult for customers to understand. A standard motor insurance policy in India runs 12–20 pages. A health insurance policy can be 25–40 pages. A corporate insurance programme can run hundreds of pages. Generative AI can transform this by enabling: (a) natural language Q&A over the policy ("Is water damage covered?"), and (b) plain-English policy summaries that highlight what matters most to the customer.

4.1 The RAG Architecture for Policy Q&A

Retrieval-Augmented Generation (RAG) is the architecture that makes policy Q&A reliable. Instead of asking the LLM to answer from its training memory (which may have incorrect or outdated insurance knowledge), RAG first retrieves the relevant policy clauses from a vector database containing the actual policy document, and then asks the LLM to answer based ONLY on the retrieved text. This grounds the LLM's response in the actual policy wording — dramatically reducing hallucination.

ARCHITECTURE: RAG for Insurance Policy Q&A

1. DOCUMENT INGESTION
   • Parse policy PDF → Extract text by section
   • Chunk text into segments (e.g., by clause/clause sub-section)
   • Generate vector embedding for each chunk
   • Store in vector database (Pinecone, Weaviate, pgvector)

2. QUERY PROCESSING
   • User asks: "Does my motor policy cover engine damage from waterlogging?"
   • Generate embedding of the question
   • Retrieve top 3–5 most relevant chunks from vector DB
   • The retrieved chunks contain the actual policy wording on water damage

3. ANSWER GENERATION
   • LLM receives: Retrieved chunks + User question
   • LLM instructed: "Answer ONLY based on the provided text.
     If the provided text does not contain the answer, say
     'Your policy document does not clearly address this.
     Please contact our claims team for clarification.'"
   • LLM generates response with clause references

4. AUDIT LOG
   • Every Q&A is logged with: question, retrieved chunks, LLM response
   • Enables quality monitoring and continuous improvement

4.2 The Policy Summary Prompt

Generating a plain-English policy summary is one of the most useful GenAI applications in insurance. A well-designed prompt produces a summary that a customer can actually understand, highlighting what is covered, what is not, and what they need to do.

You are an insurance policy advisor. Your job is to translate complex insurance policy
language into plain, simple English that a non-expert customer can understand.

Read the following policy clauses and produce a structured summary in this format:

## What This Policy Covers
[List the main coverages in simple bullet points. Use "up to ₹X" language where applicable.]

## What This Policy Does NOT Cover (Exclusions)
[List the most important exclusions that a typical customer might expect to be covered.
Focus on exclusions that surprise people. Use plain English.]

## Important Conditions
[Things the customer MUST do to keep the policy valid — timely premium payment,
disclosure requirements, claim notification timelines, etc.]

## Key Numbers
| Item | Amount | Notes |
| Sum Insured | ₹X | Maximum the policy pays |
| Premium | ₹X/year | Current annual premium |
| Deductible | ₹X | Amount you pay before insurance starts |
| No Claim Bonus | Up to X% | Discount for claim-free years |

## One-Line Summary
[A single sentence that captures the essence of what this policy does.]

POLICY TEXT:
[Paste the key clauses of the policy here — typically the "Coverage" section,
"Exclusions" section, and "Conditions" section]
📝
Note: A policy summary generated by AI must always include a disclaimer: "This is a summary of key policy features. The actual policy document is the binding legal contract. For specific coverage decisions, please refer to your policy document or contact our claims team." Several insurers have faced regulatory action because customers relied on AI-generated summaries that omitted important exclusions. The summary is a helpful guide — it is not a substitute for the policy contract.
📋 Stable content — Reviewed: July 2026

5. Claims Document Processing with GenAI

Claims generate large volumes of unstructured documents — FNOL forms, police reports, medical records, surveyor reports, repair estimates, and customer correspondence. Processing these documents manually is slow, inconsistent, and expensive. GenAI can extract structured data from these documents, classify them, flag inconsistencies, and populate the claims system — dramatically reducing manual data entry and accelerating the claims lifecycle.

5.1 Key GenAI Applications in Claims Documents

Document TypeGenAI ApplicationWhat It ExtractsValue
FNOL Form (Text)NLP extraction of claim details from free-text descriptionDate, time, location, parties involved, damage description, cause of loss, witness informationEliminates manual data entry — claim created in system with zero keystrokes
Police Report (FIR)Extract case details, verify claim consistencyFIR number, date, sections of law, vehicle numbers, parties named, accident descriptionCross-check customer's claim narrative against official record — flag discrepancies
Medical RecordsExtract diagnosis, procedures, length of stay, discharge summaryDiagnosis codes (ICD-10), procedure codes, admission/discharge dates, treating doctor, pharmacy chargesAutomate health claims assessment — reduce TPA processing time from days to hours
Surveyor ReportSummarise findings and extract damage assessmentDamage description, estimated repair cost, salvage value, photos annotated with damage tagsAuto-populate assessment system — reduce surveyor typing workload
Repair EstimateItemise parts and labour, flag inflated chargesParts list with costs, labour hours and rates, total estimate, GST breakdownCompare against benchmark costs — flag estimates above market rates for review

5.2 The Extraction Prompt

You are a claims document processing assistant. Extract structured information from the
following FNOL description and output it as a JSON object.

Extract these fields:
- claim_type: [One of: Motor_Accident, Motor_Theft, Health, Property_Fire, Property_Natural_Disaster, Travel, Other]
- incident_date: [YYYY-MM-DD format, or null if not specified]
- incident_location: [City/Area name, or null]
- policy_number: [If mentioned, or null]
- damage_description: [Brief summary of the damage/injury]
- estimated_damage_severity: [Low/Medium/High based on description]
  - Low: Minor scratches, bumps, outpatient treatment
  - Medium: Significant damage requiring repair, hospitalisation < 3 days
  - High: Total loss, major injury, hospitalisation > 3 days
- third_party_involved: [true/false]
- police_fir_available: [true/false/not_specified]
- witness_available: [true/false/not_specified]
- urgent: [true/false — true if there is injury, fire, or ongoing risk]
- key_phrases: [Array of important phrases from the text]

FNOL DESCRIPTION:
[Paste the customer's claim description here]

OUTPUT ONLY THE JSON OBJECT. No explanations, no notes.
💡
Pro Tip: For production claims document processing, use LLMs with vision capabilities (GPT-4o, Claude 3.5, Gemini) to process scanned documents and photos. A claims adjuster can upload a photo of a damaged car, a handwritten repair estimate, and a police FIR — and the LLM can extract structured data from all three simultaneously. This is the single highest-ROI GenAI use case in claims operations because it eliminates the most tedious part of the adjuster's job: manual data entry from multiple sources. Early adopters report 60–80% reduction in claims data entry time.
⚠ Volatile content — Reviewed: July 2026 · Next review: August 2026

6. Regulatory & Ethical Guardrails

Generative AI in insurance operates in one of the most regulated environments in the economy. The capabilities of LLMs — generating human-like text, answering questions, making recommendations — directly intersect with regulatory requirements around consumer protection, fair treatment, data privacy, and transparency. The guardrails described here are based on current regulatory frameworks (IRDAI, DPDP Act, EU AI Act) that are themselves evolving rapidly. This section should be checked for updates before any GenAI deployment.

6.1 The Three Red Lines

There are three categories of GenAI application in insurance that are not ready for unsupervised production use — regardless of how good the model appears to be in testing:

6.2 The Mandatory Disclosures

Any GenAI system that interacts with customers or produces output that reaches customers must include the following disclosures:

6.3 The Human-in-the-Loop Requirement

For any GenAI application that touches coverage, pricing, or claims decisions, there must be a meaningful human review process. "Meaningful" means: the human has the authority to override the AI's recommendation, has access to the source documents the AI used, and is not merely rubber-stamping the AI's output. A human reviewing 50 AI-generated claim recommendations per hour is not providing meaningful oversight — they are providing the appearance of it. The human-to-AI ratio must be calibrated to allow genuine review, not just approval.

Warning: Regulatory guidance on GenAI in insurance is evolving rapidly. In June 2026, IRDAI constituted a seven-member AI Working Group (chaired by Sandeep K. Shukla, IIIT Hyderabad) tasked with developing India's first formal AI governance framework [3]. The EU AI Act classifies insurance underwriting and pricing as "high-risk AI systems" requiring conformity assessments [2], and the U.S. NAIC has issued a Model Bulletin on AI use by insurers [1]. India's DPDP Act 2023 restricts automated decision-making that produces "significant legal effects" on individuals. Any organisation deploying GenAI in insurance must have legal counsel review their specific use case against the current regulatory framework. The guidance in this section is based on publicly available information as of August 2026 and should not be construed as legal advice. The regulatory landscape for AI in insurance is changing faster than any textbook can capture — check this section's review date and supplement with current regulatory research.
⚠ Volatile content — Reviewed: July 2026 · Next review: August 2026

7. Evaluating GenAI Use Cases in Insurance

Not every insurance problem is a GenAI problem. The technology creates the most value where it plays to its strengths — language understanding, summarisation, content generation, and conversational interaction — and the least value where precision, determinism, and regulatory compliance are paramount. The following framework helps evaluate which GenAI use cases to prioritise.

7.1 The Value-Risk Framework

Every GenAI use case in insurance can be plotted on two axes: business value and implementation risk. For a Finance-specialization audience, read these two axes through enterprise-risk-management (ERM) vocabulary you already know: business value is a standard ROI question — payback period and NPV of the annual savings (e.g., ₹2 crore/year call-centre savings, a 20% increase in underwriter throughput, a 60% reduction in data-entry time) against the build cost, discounted at the insurer's cost of capital. Implementation risk is a risk-appetite and control-environment question — whether the use case sits within the firm's stated risk appetite, and whether the three-lines-of-defense (business ownership, independent risk oversight, internal audit) are in place before deployment. Value and risk are not separate lists; they are two dimensions of the same investment-appraisal decision.

QuadrantDescriptionInsurance ExamplesRecommendation
High Value, Low Risk — DEPLOY NOW Use cases where the AI operates in a bounded scope with clear guardrails and the cost of error is low. Policy document summarisation for internal use, claims document data extraction (human-reviewed), internal knowledge base Q&A for employees, call centre agent assistance (suggestions only), email draft generation for renewal reminders Implement immediately with monitoring. These are "productivity multiplier" use cases that require minimal regulatory review.
High Value, High Risk — PROCEED WITH CAUTION Use cases with significant business impact but real regulatory, accuracy, or customer trust risks. Customer-facing chatbot for policy Q&A (requires RAG + human escalation), claims severity estimation from documents (requires validation), automated FNOL processing (requires human audit), customer-facing plain-English policy summaries (requires legal review) Proceed with controlled pilot. Invest in guardrails (RAG, human-in-the-loop, monitoring). Deploy in shadow mode first. Expect 12–18 months to full production.
Low Value, Low Risk — CONSIDER, BUT LOW PRIORITY Useful but not transformative. Low implementation risk but limited business impact. Generating social media posts for insurance awareness, internal newsletter content creation, translating marketing materials into regional languages Implement if spare capacity exists. Low risk but also low strategic impact. Not worth significant investment.
Low Value, High Risk — AVOID Use cases where the risk of error or regulatory exposure outweighs the potential benefit. Automated claim denial letters without human review, direct-to-consumer insurance advice without policy context, automated underwriting decisions based on LLM reasoning, premium quotes generated by LLM without rating engine Do not deploy in current regulatory environment. Monitor regulatory developments. These may become feasible with significantly stronger guardrails or clearer regulatory guidance.

7.2 The Evaluation Checklist

Before approving any GenAI use case for production, answer these six questions:

  1. Would an error in this output cause financial harm to a customer? If yes, human review or a deterministic fallback is required.
  2. Is this output subject to regulatory review or audit? If yes, the output must be logged, attributable, and explainable. YOU must be able to explain why the AI produced that specific output — not just that "the AI said so."
  3. Can we measure the accuracy of the output objectively? If not (e.g., "is this summary good enough?" is subjective), the use case is harder to manage in production.
  4. What is the escalation path when the AI gets it wrong? If there is no clear path to identify, log, and correct errors, the use case is not ready for production.
  5. Is a simpler, non-GenAI solution sufficient? A deterministic rule-based system or a standard ML model may solve the problem with lower cost, lower risk, and higher reliability. GenAI should be the tool of last resort — not the first.
  6. Would we be comfortable explaining this use case to a regulator? If the answer is no, the use case needs more guardrails before deployment.
💡
Illustrative Scenario (hypothetical, for teaching purposes): An insurer deploys a GenAI chatbot for customer service, and within the first month a customer reports it to a regulator — not because the answer was wrong, but because it appeared to be a coverage guarantee when it was only a general explanation. The regulator requires an explicit disclaimer, interaction logging, and human review for coverage questions, and the remediation cost far exceeds the build cost. This is a constructed teaching example of a real regulatory principle — the insurer is held responsible for what its AI says — grounded in the NAIC Model Bulletin [1] and the EU AI Act [2], not a reported enforcement event.

Hands-On Project: Build an Insurance GenAI Application Suite

You are a GenAI product manager at "FutureSafe Insurance." Your CEO has asked you to build a suite of GenAI-powered tools for the claims and customer service teams. Your task is to design, test, and evaluate three GenAI applications using ChatGPT (or your preferred LLM). This is a prompt engineering and evaluation exercise — no coding required.

Steps

  1. Chatbot System Prompt: Write a system prompt for an insurance claims FNOL assistant chatbot. The chatbot should: (a) collect claim information step-by-step, (b) verify policy details, (c) provide a claim reference number, and (d) explain the next steps. It should NOT: (a) make coverage decisions, (b) promise payment amounts, (c) share customer data. Include escalation triggers. Test your prompt with 3 customer scenarios and paste the responses. Then identify one scenario where the chatbot responded incorrectly or inappropriately and refine your prompt.
  2. Policy Summary: Find a real insurance policy document (you can use the sample text from Appendix or find any publicly available policy wording online). Use a role-based few-shot prompt to generate a plain-English summary in the structured format from Section 4. Test the summary by asking 3 questions that a customer might ask and checking whether your summary (alone) would allow you to answer correctly. If not, revise the summary generation prompt.
  3. Claims Document Extraction: Create a realistic FNOL scenario (a short paragraph describing a motor accident, a health emergency, or a property loss). Write a structured extraction prompt that asks the LLM to output a JSON object with all relevant claim fields. Test with your scenario and two variations (different claim types). Document whether the extraction was accurate.
  4. Use Case Evaluation: Select 4 use cases from the list below. For each, plot it on the Value-Risk framework. Write a one-paragraph recommendation for each.
    • AI-generated claim denial letters (drafted by AI, reviewed by human)
    • Customer-facing chatbot for policy Q&A (RAG-based, with escalation)
    • Automated social media content for insurance awareness
    • AI-assisted underwriting — LLM summarises applicant risk factors for human underwriter
    • Real-time translation of claims documents from Hindi to English
    • AI-generated personalised wellness recommendations for health insurance customers
  5. Write a 500-word GenAI strategy brief to the CEO covering: (a) Your recommended top 3 GenAI use cases for the next 12 months, (b) For each: expected benefit, key risk, and guardrails needed, (c) The "red line" use cases you will NOT pursue and why, (d) The organisational capability needed to deploy GenAI responsibly (talent, governance, monitoring).
View Solution / Walkthrough

Sample Strategy Brief — Use Case Evaluation

Use Case 1: AI-Generated Claim Denial Letters (Human-Reviewed)

Value-Risk Position: Medium-High Value, High Risk — PROCEED WITH CAUTION
Value: Claim denial letters are time-consuming for adjusters (30–45 minutes each) and must be legally precise — mentioning the specific policy clause, the reason for denial, and the appeal process. An AI-generated first draft can reduce adjuster time by 70%. Risk: A legally inaccurate denial letter creates regulatory exposure — the customer may have grounds to appeal the denial on procedural grounds if the letter is incorrect. Guardrails: (1) AI generates the draft using RAG from the specific policy clauses referenced in the adjuster's notes. (2) Adjuster MUST review and edit every letter before sending — no auto-send. (3) Every AI-generated letter is logged and 10% are audited quarterly. (4) The AI is never allowed to create a denial letter without explicit adjuster instructions. Recommendation: Proceed with pilot — the productivity gain is significant, and the guardrails are manageable. Six-month pilot with 5 adjusters before broader rollout.

Use Case 2: Customer-Facing Chatbot for Policy Q&A (RAG-Based)

Value-Risk Position: High Value, High Risk — PROCEED WITH CAUTION
Value: Policy Q&A is the highest-volume call centre driver (35% of all calls). A well-designed chatbot can handle 60% of these queries end-to-end, saving an estimated ₹2 crore annually in call centre costs. Risk: The chatbot giving incorrect coverage information creates both regulatory and reputational risk. A customer who relies on incorrect chatbot information may make a financial decision that harms them. Guardrails: (1) RAG architecture — the chatbot only answers based on retrieved policy clauses, never from model memory. (2) Every response includes a link to the specific policy clause and a disclaimer. (3) Coverage questions beyond general explanations are escalated to human agents. (4) All conversations are logged and 5% are audited monthly. (5) The chatbot is explicitly described as an AI assistant to manage customer expectations. Recommendation: Proceed with controlled pilot on a single product line (motor insurance — most standardised) for 3 months before expanding to health and property.

Use Case 3: AI-Assisted Underwriting (LLM Summarises Risk Factors for Human Underwriter)

Value-Risk Position: High Value, Low Risk — DEPLOY NOW
Value: Underwriters spend 20–30% of their time reading application documents and summarising risk factors before making a decision. An AI that reads the application, extracts key risk factors, and presents them in a structured format can significantly increase underwriter throughput. Risk: The AI summary may miss a critical risk factor. But since the underwriter is reviewing the full application anyway, the summary is a productivity tool — the underwriter's judgment is the final decision. The AI is suggesting, not deciding. Guardrails: (1) The AI summary is clearly marked as "AI-generated — for reference only." (2) The underwriter must still review the original documents. (3) Periodic audit of AI summaries for omission rate. Recommendation: Implement immediately — low risk, high productivity gain, strong underwriter adoption likely.

Use Case 4: Automated Underwriting Decisions Based on LLM Reasoning

Value-Risk Position: Low Value, High Risk — AVOID
Risk: This is the most dangerous GenAI use case on the list. An LLM making underwriting decisions without a deterministic rating engine introduces unacceptable regulatory, ethical, and financial risk. The LLM's reasoning is opaque, its output is non-deterministic (the same input can produce different outputs), and it cannot be held accountable for its decisions. If a regulator asks "explain why this applicant was declined," the answer "the LLM determined their risk score was too high" is not a defensible response. Additional concern: The EU AI Act explicitly classifies insurance underwriting as high-risk AI. India's DPDP Act restricts automated decisions with significant legal effects. Even if the technology improved, the regulatory environment is moving toward requiring explainable, deterministic, auditable underwriting decisions — which is the opposite of what an LLM provides. Recommendation: Do not pursue in the current regulatory environment. Monitor developments in deterministic GenAI architectures (where the LLM is a conversational interface but the decision comes from a traditional ML model) which may make this more viable in 2–3 years.

Recommended Top 3 Use Cases (Next 12 Months)

  1. AI-Assisted Underwriting (Deploy Now): Summary generation for human underwriters. Estimated benefit: 20% increase in underwriter throughput. Cost: ₹15 lakh. Timeline: 6 weeks to pilot. Risk: Low.
  2. Claims Document Processing (Deploy Now): Automated data extraction from FNOL descriptions, medical records, and repair estimates. Estimated benefit: 60% reduction in claims data entry time. Cost: ₹25 lakh. Timeline: 3 months to pilot. Risk: Low-Medium (requires human audit).
  3. Customer-Facing Policy Q&A Chatbot (Pilot — Motor Only): RAG-based chatbot for motor insurance policy questions. Estimated benefit: ₹2 crore annualised call centre savings at full rollout. Cost: ₹40 lakh (including RAG infrastructure, legal review, and monitoring). Timeline: 6 months to pilot, 12 months to full rollout. Risk: Medium-High (requires careful guardrails and regulatory review).

Red Lines (Will Not Pursue): AI-generated coverage decisions, AI-generated premium quotes, AI-driven underwriting without human review, and any customer-facing use of GenAI without explicit AI disclosure. These red lines are based on the current regulatory environment and will be reviewed quarterly.

Organisational Capability Needed: To deploy GenAI responsibly, we need: (a) A GenAI governance committee with representation from Legal, Compliance, Risk, Operations, and Technology — meeting monthly to review use cases, incident reports, and regulatory developments. (b) A standardised GenAI use case evaluation process based on the Value-Risk framework. (c) Investment in RAG infrastructure (vector database, document ingestion pipeline) that can be shared across use cases. (d) A monitoring and logging platform for all GenAI outputs — because what cannot be measured cannot be governed. (e) Training for all teams on GenAI capabilities, limitations, and responsible use — including the mandatory disclosures and escalation requirements.

Key Takeaways

1

LLMs generate text based on statistical patterns in training data — they do not "know" anything. Hallucination is not a bug; it is the architectural feature that enables both creativity and error. Managing hallucination through prompt engineering and RAG is the core skill of GenAI in insurance.

2

Four prompt engineering patterns — role-based, few-shot, chain-of-thought, and structured output — cover 90% of insurance use cases. Adding a verification step to prompts is the single most effective technique for reducing hallucination in insurance applications.

3

A well-designed insurance chatbot has clear scope boundaries defined in the system prompt, a RAG architecture that grounds answers in actual policy documents, and explicit escalation triggers for queries it cannot handle. The bot's primary job is knowing when to hand off to a human.

4

Policy document Q&A and claims document extraction are the highest-ROI GenAI applications in insurance today. RAG architectures ensure answers are grounded in actual documents. Policy summaries must include disclaimers — they are helpful guides, not substitutes for the policy contract.

5

The Value-Risk framework (business value × implementation risk) separates deploy-now use cases from avoid-entirely ones. Three red lines: coverage decisions, personalised premium quotes, and individualised risk assessments are not suitable for unsupervised GenAI in the current regulatory environment.

References

  1. National Association of Insurance Commissioners (NAIC), "Model Bulletin: Use of Artificial Intelligence Systems by Insurers," NAIC, Kansas City, MO, USA, 2023. [Online]. Available: https://content.naic.org/sites/default/files/call_materials/REGULATORY%20GUIDANCE%20PCKG%206-3-24.pdf
  2. MDPI Risks, "Algorithmic Bias Under the EU AI Act: Compliance Risk, Capital Strain, and Pricing Distortions in Life and Health Insurance Underwriting," Risks, vol. 13, no. 9, art. 160, 2025. [Online]. Available: https://www.mdpi.com/2227-9091/13/9/160
  3. Insurance Business Magazine (Asia), "India's insurance regulator steps in to govern AI adoption," June 2026. [Online]. Available: https://www.insurancebusinessmag.com/asia/news/technology/indias-insurance-regulator-steps-in-to-govern-ai-adoption-579846.aspx
  4. Baker Tilly, "The regulatory implications of AI and ML for the insurance industry." [Online]. Available: https://www.bakertilly.com/insights/the-regulatory-implications-of-ai-and-ml-for-the-insurance-industry

Required reading (Task G5): NAIC Model Bulletin [1] is this session's finance/governance anchor reading; Baker Tilly [4] is the complementary regulatory-analysis reading.

Test Your Understanding

1. An LLM generates a response that includes specific coverage details that are not present in the insurance policy document provided. The most likely cause is:

2. The MOST important architectural component for a production insurance policy Q&A chatbot is:

3. A customer asks an insurance chatbot: "My health claim was rejected. Can you explain why and reverse the decision?" The CORRECT chatbot response is:

4. In the Value-Risk framework for evaluating GenAI use cases, "AI-assisted underwriting — LLM summarises applicant risk factors for human review" is classified as:

5. An insurer deploys a GenAI chatbot for customer service but does not log chatbot interactions or audit responses. Six months later, a regulator requests all chatbot interactions from the past year. The insurer cannot produce them. This scenario represents a failure of: