Innovative Digital Storytelling with AIGC: Exploration and Discussion of Recent Advances

September 25, 2023 · Entered Twilight · 🏛 arXiv.org

"No code URL or promise found in abstract"
"Derived repo from GitHub Pages (backfill)"

Evidence collected by the PWNC Scanner

Repo contents: .DS_Store, ContactPage-1, P5-Music, P5-Videos, README.md, bootstrap, css, fonts, images, images2, index.html, index2.html, js, plugins

Authors Rongzhang Gu, Hui Li, Changyue Su, Wayne Wu arXiv ID 2309.14329 Category cs.HC: Human-Computer Interaction Cross-listed cs.AI, cs.CV, cs.GR, cs.MM Citations 9 Venue arXiv.org Repository https://github.com/lsgm-demo/Leveraging-recent-advances-of-foundation-models-for-story-telling Last Checked 1 month ago

Abstract

Digital storytelling, as an art form, has struggled with cost-quality balance. The emergence of AI-generated Content (AIGC) is considered as a potential solution for efficient digital storytelling production. However, the specific form, effects, and impacts of this fusion remain unclear, leaving the boundaries of AIGC combined with storytelling undefined. This work explores the current integration state of AIGC and digital storytelling, investigates the artistic value of their fusion in a sample project, and addresses common issues through interviews. Through our study, we conclude that AIGC, while proficient in image creation, voiceover production, and music composition, falls short of replacing humans due to the irreplaceable elements of human creativity and aesthetic sensibilities at present, especially in complex character animations, facial expressions, and sound effects. The research objective is to increase public awareness of the current state, limitations, and challenges arising from combining AIGC and digital storytelling.