innovator

Add idea


Calendar

«    September 2019    »
MonTueWedThuFriSatSun
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
 

 

Advert

 

Payment

 

Advert

 

Authorization

Стартап
DateDate: 11-09-2019, 05:48

The neural network was taught to transform the image into music.
Researchers from the University of Amsterdam presented a neural network that can relate visual sensations to sounds - and turn pictures into music. The work was published in an article on arXiv.org, and will be presented at the ICCVW 2019 conference.
When teaching the algorithm, the researchers did not show him how to correlate the image with the music - the neural network received these skills on its own using the teaching method without a teacher.
The algorithm is built on the principle of an auto-encoder and consists of an encoder and a decoder that work with different data - in this case, with images and sounds.
 
The encoder studied on the MNIST dataset, which contains 60 thousand handwritten characters, and on the Behance Artistic Media dataset, which includes about 180 thousand oil and watercolor paintings.
The neural network first performs the conversion from the image to music, it performs the reverse conversion from the received music to a new image, after which it is compared with the original one.





Add comment

Your name:*
Your E-Mail:*
Input code
from the picture*
Enable this picture to display the security code
reload, if the code cannot be seen