Automatic Understanding of Image and Video Advertisements

July 10, 2017 · Entered Twilight · 🏛 Computer Vision and Pattern Recognition

"No code URL or promise found in abstract"
"Code repo scraped from project page (backfill)"

Evidence collected by the PWNC Scanner

Repo contents: README.md, build.sh, configs, data, docs, losses, models, output, prepare_data.sh, protos, readers, scripts, text_encoders, tools, train.sh, train, utils, visualization

Authors Zaeem Hussain, Mingda Zhang, Xiaozhong Zhang, Keren Ye, Christopher Thomas, Zuha Agha, Nathan Ong, Adriana Kovashka arXiv ID 1707.03067 Category cs.CV: Computer Vision Citations 193 Venue Computer Vision and Pattern Recognition Repository https://github.com/yekeren/ADVISE ⭐ 26 Last Checked 1 month ago

Abstract

There is more to images than their objective physical content: for example, advertisements are created to persuade a viewer to take a certain action. We propose the novel problem of automatic advertisement understanding. To enable research on this problem, we create two datasets: an image dataset of 64,832 image ads, and a video dataset of 3,477 ads. Our data contains rich annotations encompassing the topic and sentiment of the ads, questions and answers describing what actions the viewer is prompted to take and the reasoning that the ad presents to persuade the viewer ("What should I do according to this ad, and why should I do it?"), and symbolic references ads make (e.g. a dove symbolizes peace). We also analyze the most common persuasive strategies ads use, and the capabilities that computer vision systems should have to understand these strategies. We present baseline classification results for several prediction tasks, including automatically answering questions about the messages of the ads.