Mitigating Hallucinations in Large Vision-Language Models via Summary-Guided Decoding (NAACL 2025 Findings)

Abstract

This repository provides the official implementation of our paper Mitigating Hallucinations in Large Vision-Language Models via Summary-Guided Decoding. We introduce a novel decoding strategy designed to reduce hallucinations in Large Vision-Language Models (LVLMs) by leveraging summary-based guidance to enhance response generation. Our approach significantly improves model performance on tasks requiring strong visual grounding while effectively reducing reliance on language priors. Our paper is accepted at NAACL 2025 Findings.

Method Overview

We present two variants of our Summary-Guided Decoding approach:

1. SumGD with Self-Summarization (SumGD-S): The LVLM generates its own summary before performing guided decoding
2. SumGD with Distilled Flan-T5 (SumGD-D): Utilizes a distilled summary model for more efficient summary generation

Installation

# Create and activate a conda environment
conda create -n sumgd
conda activate sumgd

# Install our modified transformers library
python -m pip install -e transformers-4.29.2

# Install dependencies
pip install -r requirements.txt

Required Model Checkpoints

Please download the following model checkpoints:

• LLaVA-1.5 merged 7B model

  • Update the path in eval_configs/llava-1.5_eval.yaml at Line 14

• Vicuna 7B v1.1 model

  • Update the path in minigpt4/configs/models/blip2_instruct_vicuna7b.yaml at Line 25

Implementation Details

The core implementation of our Summary-Guided Decoding approach can be found in:

• transformers-4.29.2/src/transformers/generation/utils.py (base implementation)
• summary_guided_decoding.py (SumGD-S implementation)
• summary_guided_decoding_distill.py (SumGD-D implementation)

Evaluation

Dataset Preparation

Our evaluation requires the MSCOCO 2014 dataset. Download it from the official website and extract it to your preferred data path.

Running Inference

Generate responses using our Summary-Guided Decoding approach:

# SumGD-S (Self-Summary Guidance)
python chair_summary_guided_decoding.py \
  --model llava-1.5 \
  --sumgd_mode sumgd-s \
  --max_new_token 512 \
  --min_new_token 1 \
  --result_path /path/to/save/results.jsonl

# SumGD-D (Distilled Summary Guidance)
python chair_summary_guided_decoding.py \
  --model llava-1.5 \
  --sumgd_mode sumgd-d \
  --max_new_token 512 \
  --min_new_token 1 \
  --result_path /path/to/save/results.jsonl

Computing CHAIR Metrics

After generating responses, compute CHAIR metrics with:

python chair.py \
  --cap_file /path/to/results.jsonl \
  --image_id_key image_id \
  --caption_key caption \
  --coco_path /path/to/COCO/annotations_trainval2014/annotations/ \
  --save_path /path/to/save/chair_metrics.json

Baseline Comparison

To run baseline decoding methods instead of Summary-Guided Decoding, modify the following code in chair_summary_guided_decoding.py:

# Base Decoding
with torch.inference_mode():
    with torch.no_grad():
        out = model.generate( 
            {"image": norm(image).half(), "prompt": qu}, 
            use_nucleus_sampling=False, 
            num_beams=1,
            max_new_tokens=args.max_new_token,
            min_new_tokens=args.min_new_token, 
            summary_guided_decoding=False  # Set to False for standard decoding
        )

Acknowledgements

This repository builds upon the following excellent codebases:

• LAVIS
• MiniGPT-4
• OPERA
• CHAIR Evaluation

We sincerely appreciate their contributions to the research community.

Citation

If you find our work useful, please consider citing our paper:

@misc{min2025mitigatinghallucinationslargevisionlanguage,
      title={Mitigating Hallucinations in Large Vision-Language Models via Summary-Guided Decoding}, 
      author={Kyungmin Min and Minbeom Kim and Kang-il Lee and Dongryeol Lee and Kyomin Jung},
      year={2025},
      eprint={2410.13321},
      archivePrefix={arXiv},
      primaryClass={cs.AI},
      url={https://arxiv.org/abs/2410.13321}, 
}