Facebook Games To Make A Better Music Search Engine
Posted on June 05, 2009 at 11:12:23 pm
“The Facebook games are a lot of fun and a great way to discover new music. At the same time, the games deliver the data we need to teach our computer audition system to listen to and describe music like humans do,” said Gert Lanckriet, the electrical engineering professor and machine learning expert from the UC San Diego Jacobs School of Engineering steering the project. To play Herd It, log in to Facebook, open the Herd It app, select a genre of music, and start listening to song clips and playing the games. Some games ask users to identify instruments, while others focus on music genres, artist names, emotions triggered by the song, and activities you might do while listening to a song. The more your answers align with the rest of the online crowd playing the game at the same time, the more points you score. Watch a two minute video about the making of the games and the new search engine at http://www.jacobsschool.ucsd.edu/news/news_video/play.sfe?id=28.
“The more examples of romantic songs our search engine is exposed to, the more accurately it will be able to identify romantic songs it has never heard before,” explained Luke Barrington, the UC San Diego electrical engineering Ph.D. student leading the project.
-ADVERTISEMENT-Part of Barrington’s Ph.D. dissertation will involve demonstrating that data collected from the Facebook games reliably improves the accuracy of their automated search engine for music.
“Once enough people play our new music discovery games on Facebook, I’ll have the data I need to both improve our search engine and finish my Ph.D.,” said Barrington.
The song-word combinations collected by the Facebook games also enable the researchers to grow their music search engine’s vocabulary and increase its coverage in genres and classes of music.
How it works For the music search engine from UC San Diego to “listen and describe music like a human,” it must find patterns in the songs using the tools of machine learning. For example, for the system to learn to identify and label romantic songs, it must be exposed to many different romantic songs during the training period. The Facebook games provide the data necessary for the algorithms to learn to label songs on their own.
This exposure to songs tagged with the relevant labels enables the machine learning algorithms find patterns in the wave forms of the songs that make the songs romantic. Once trained, the system can identify romantic songs that it has never before encountered, offering the tantalizing possibility of amassing a huge database of songs that can be tagged and retrieved based on text-based searches with no human intervention. This technical capability is increasingly important as music goes entirely digital and the ways in which people find music change.