multimodal steering

Gaze Heads: Steering VLMs by Redirecting Attention

A small set of attention heads can steer a VLM to describe a chosen image region without retraining.