Translating Visual Art into Music

September 03, 2019 Β· Declared Dead Β· πŸ› 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW)

πŸ‘» CAUSE OF DEATH: Ghosted
No code link whatsoever

"No code URL or promise found in abstract"

Evidence collected by the PWNC Scanner

Authors Maximilian MΓΌller-Eberstein, Nanne van Noord arXiv ID 1909.01218 Category cs.CV: Computer Vision Cross-listed cs.HC, cs.LG, cs.SD, eess.AS Citations 8 Venue 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) Last Checked 4 months ago
Abstract
The Synesthetic Variational Autoencoder (SynVAE) introduced in this research is able to learn a consistent mapping between visual and auditive sensory modalities in the absence of paired datasets. A quantitative evaluation on MNIST as well as the Behance Artistic Media dataset (BAM) shows that SynVAE is capable of retaining sufficient information content during the translation while maintaining cross-modal latent space consistency. In a qualitative evaluation trial, human evaluators were furthermore able to match musical samples with the images which generated them with accuracies of up to 73%.
Community shame:
Not yet rated
Community Contributions

Found the code? Know the venue? Think something is wrong? Let us know!

πŸ“œ Similar Papers

In the same crypt β€” Computer Vision

πŸŒ… πŸŒ… Old Age

Fast R-CNN

Ross Girshick

cs.CV πŸ› ICCV πŸ“š 27.7K cites 11 years ago

Died the same way β€” πŸ‘» Ghosted