Translating Visual Art into Music
September 03, 2019 Β· Declared Dead Β· π 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW)
"No code URL or promise found in abstract"
Evidence collected by the PWNC Scanner
Authors
Maximilian MΓΌller-Eberstein, Nanne van Noord
arXiv ID
1909.01218
Category
cs.CV: Computer Vision
Cross-listed
cs.HC,
cs.LG,
cs.SD,
eess.AS
Citations
8
Venue
2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW)
Last Checked
4 months ago
Abstract
The Synesthetic Variational Autoencoder (SynVAE) introduced in this research is able to learn a consistent mapping between visual and auditive sensory modalities in the absence of paired datasets. A quantitative evaluation on MNIST as well as the Behance Artistic Media dataset (BAM) shows that SynVAE is capable of retaining sufficient information content during the translation while maintaining cross-modal latent space consistency. In a qualitative evaluation trial, human evaluators were furthermore able to match musical samples with the images which generated them with accuracies of up to 73%.
Community Contributions
Found the code? Know the venue? Think something is wrong? Let us know!
π Similar Papers
In the same crypt β Computer Vision
π
π
Old Age
π
π
Old Age
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
π
π
Old Age
SSD: Single Shot MultiBox Detector
π
π
Old Age
Squeeze-and-Excitation Networks
π
π
Old Age
Fast R-CNN
π
π
Old Age
Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization
Died the same way β π» Ghosted
R.I.P.
π»
Ghosted
Federated Learning: Strategies for Improving Communication Efficiency
R.I.P.
π»
Ghosted
In-Datacenter Performance Analysis of a Tensor Processing Unit
R.I.P.
π»
Ghosted
Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning
R.I.P.
π»
Ghosted