Post
97
š VQAScore now supports text-to-video evaluation!
VQAScore scores how well a generated image or video matches a prompt by asking a VLM "does this show {prompt}?" and using P(Yes). It became a go-to evaluation metric and reward model for image generation (2M+ downloads), and we just added text-to-video support across 20+ VLMs (GPT, Gemini, Qwen). Free and open-source, and it keeps improving as VLMs improve.
š» Code: https://github.com/linzhiqiu/t2v_metrics
š Paper: https://arxiv.org/abs/2404.01291
š§µ Launch thread + demo video: https://x.com/ZhiqiuLin/status/2064316582461841499
VQAScore scores how well a generated image or video matches a prompt by asking a VLM "does this show {prompt}?" and using P(Yes). It became a go-to evaluation metric and reward model for image generation (2M+ downloads), and we just added text-to-video support across 20+ VLMs (GPT, Gemini, Qwen). Free and open-source, and it keeps improving as VLMs improve.
š» Code: https://github.com/linzhiqiu/t2v_metrics
š Paper: https://arxiv.org/abs/2404.01291
š§µ Launch thread + demo video: https://x.com/ZhiqiuLin/status/2064316582461841499