In a groundbreaking study, researchers at the University of California, Berkeley, have developed an artificial intelligence (AI) system that can recreate a clip of Pink Floyd’s iconic song Another Brick in the Wall, Part 1 by analyzing brain activity. Interestingly, the AI-generated clip achieved a remarkable 43 percent similarity to the original song clip.
The team, led by Robert Knight, utilized brain recordings from 29 individuals with epilepsy who had undergone surgery to implant electrodes on their brain surface. These participants listened to Another Brick in the Wall, Part 1 while their brain activity was recorded. By comparing the brain signals with the song, the researchers identified specific electrode recordings that were strongly connected to the song’s pitch, melody, harmony, and rhythm.
Utilizing these findings, the team trained an AI to establish links between brain activity and musical components. The AI excluded a 15-second portion of the song from its training data and then generated a prediction of this missing snippet based on the participants’ brain signals. This resulted in the creation of an AI-generated clip that closely resembled the missing segment of the original song.
While the AI-generated clip undergoes some degradation during the conversion from a spectrogram to audio format, the researchers were able to implement some processing to ensure a fair comparison with the original clip.
This pioneering research not only demonstrates the potential of AI in recreating musical content based on brain activity but also provides valuable insights into how we perceive sound. Moreover, this study opens up new possibilities for the development of advanced speech-related technologies that could significantly benefit individuals with speech difficulties.
Q: What is an artificial intelligence (AI)?
A: Artificial intelligence refers to machines or computer systems that can perform tasks that typically require human intelligence, such as learning, problem-solving, and decision-making.
Q: What is a spectrogram?
A: A spectrogram is a visual representation of the frequencies of a sound over time. It is often used to analyze and visualize audio signals.