Back to AI News
arxiv

Q-CamTuning: Multimodal LLM for Fine-Grained Quality Reasoning in Livestreaming Camera Tuning

The paper introduces Q-CamTuning, a multimodal large language model designed for automatic camera tuning in livestreaming. It addresses limitations of existing IQA methods by enabling fine-grained quality comparison and providing reasoning-based adjustment suggestions. The authors built a new instruction tuning dataset, FGLive-Comments, and a progressive perception-evidence-guidance framework. Experiments show Q-CamTuning outperforms existing IQA models in quality scoring and pair ranking, with user studies confirming its practical suggestions.

AI Brief

This is a concrete research contribution combining multimodal LLMs with a practical application (camera tuning), offering a new dataset and framework with demonstrated improvements.

arXiv:2611.03007v1 Announce Type: cross Abstract: With the popularization of livestreaming applications, automatic camera tuning has become indispensable for ordinary users to enjoy high Quality of Experience (QoE). However, the existing Image Quality Assessment (IQA) methods face two challenges in camera tuning. First, they struggle to identify subtle quality difference between images, which is common in camera tuning. Second, the ability to explain fine-grained differences and to provide suggestions for camera tuning are even more lacking. To address these challenges, we first construct FGLive-Comments, an instruction tuning dataset with rich annotations of both preferences for fine-grained image pairs and quality reasoning from global and local visual evidence, which supports selective adjustment recommendations of camera parameters. Based on FGLive-Comments, we develop Q-CamTuning, a multimodal large language model for livestreaming camera tuning. Its progressive perception-evidence-guidance framework learns quality-aware visual representations, enhances fine-grained reasoning with global-local evidence, and maps quality issues to camera-parameter adjustment directions. Extensive experimental results demonstrate that Q-CamTuning outperforms existing IQA models in both quality scoring and fine-grained image pair ranking. User study also validates its ability to recommend camera tuning suggestions.
Be the first to rate this article.

Comments & Questions (0)

Captcha
Please be respectful — let's keep the conversation friendly.

No comments yet

Be the first to comment!