Live intelligence

Latest AI updates

1 updates
Research Editor selected

Specify Privacy Yourself: Assessing Inference-Time Personalized Privacy Preservation Ability of Large Vision-Language Models

The paper introduces Inference-Time Personalized Privacy Protection (ITP^3), a task in which users dynamically specify privacy boundaries through language. It presents SPY-Bench, described as the first systematic assessment of this ability, with 32,700 image-question samples and personalized privacy instructions across 67 categories and 24 real-world scenarios. Benchmarking 21 state-of-the-art LVLMs shows poor compliance, with even o4-mini reaching only about 24% accuracy, and limited contextual privacy understanding. The authors implement initial alignment methods, including a Noise Contrastive Alignment variant reporting 96.88% accuracy while maintaining reasonable general performance.

Why it matters: It provides a concrete benchmark and empirical evidence on a new personalized privacy-control task for vision-language models, useful for researchers working on LVLM safety and alignment.

Large Vision-Language ModelsPrivacy preservationSPY-Bench