Shivangi Tripathi

Research

My research asks one question: when a generative AI model produces an answer, a caption, or a clinical note, can we trust it, and if not, can we fix it? I work on this question in the areas below.

Faithful image captions for safety-critical traffic scenes (MS-CAPS)

2025 – present

When a vision-language model shortens a caption, it can drop details that matter for safety, such as a pedestrian or a traffic signal. MS-CAPS uses a knowledge graph to shorten traffic-scene captions to a minimal sufficient form, and checks each caption by asking an image generator (FLUX.1-dev) to rebuild the scene from it.

Related papers: EACL 2027 (see Publications)

Hallucinations in clinical speech

2025 – present

AI systems that write clinical notes from doctor–patient conversations can turn a listening mistake, such as a misheard drug name, into a false statement in the note. I compare speech-to-text-then-LLM systems with models that listen to audio directly, and trace where each error starts.

Correcting hallucinations in generated text (REVISE)

2024 – present

Language models often write paragraphs that mix correct and incorrect statements. REVISE splits a paragraph into individual claims, checks each claim against retrieved evidence, and rewrites only the claims that are not supported, keeping the rest of the paragraph the same.

Related papers: AITest 2025, DISTILL 2025, CCNC 2026 (see Publications)

Adversarial testing of language models

2024

I measure how small changes to a prompt increase hallucination in open language models, so that detection and correction methods can be tested under realistic pressure.

Related papers: MobiSecServ 2024 (see Publications)