While we wait for the PS5 release or at least its design, Sony continues to actively publish patents. According to the latest patent, the PS5 could soon dynamically control your music.
Where does the information come from? It is a patent that has been published on patentscope. These patents describe ideas and designs from Sony that are not necessarily intended to be implemented in the PS5.
However, it is interesting what this patent entails. Because music plays an important role for many players – especially when it comes to emotions. We will explain how exactly the PS5 should take on this task for music or what it is supposed to do.
The perfect soundtrack thanks to AI – How does it work?
Before the actual process, the artificial intelligence is fed with metadata: This is how the system should be able to distinguish between certain areas:
- Between characters like the main character, partner, boss enemies, wizards, etc.
- Activities like combat, relaxation, or planning
- Or what areas there are, such as forest, city, or desert
How exactly is this supposed to work? Sony describes in its patent the individual steps that the system should perform so that players can hear the right music:
- First, the system collects data from the finished music that the game has. In the next step, the system breaks down the music into its components: melodies, harmonies, and rhythms.
- In the third step, the system collects emotional data. Reviews, postings, or texts are also to be evaluated to better capture the emotions.
- Finally, an artificial intelligence (convolutional neural network) connects the music metadata with the analysis of the emotional data.
What else does the artificial intelligence do? It analyzes the game itself: the individual areas, the emotions, and which components are characteristic for the game:
- The locations, attributes, or spells are then linked with the emotional data
- Each individual character, landscapes, or scenes have a specific music motif that the system can recognize.
- The analyzed data can then be linked to the player’s emotions.
Emotions as the most important element for music
The artificial intelligence should be able to recognize with some practice which music should be played at what time and can also already “plan ahead”:
If a dark cave comes after the current level section, the game could emotionally cue the music in advance thanks to artificial intelligence.
According to the patent, the Artificial Intelligence can always offer you the right music at the right moment.
Sony emphasizes in the patent that the emotions of the players are of the utmost importance and very important for the music. These include feelings such as joy, tenderness, peacefulness, but also nostalgia or pain.
And besides interesting music, the very fast SSD in the PS5 and Xbox Series X could also bring features into the game that developers always had to scrap. Because players absolutely dislike loading times:
PS5 Release – Are there any more patents?
Sony has now filed several patents regarding the PlayStation:
- A patent is supposed to be a solution against nausea in VR
- Another patent is supposed to protect players against nasty spoilers.
- Another possibility is an intelligent AI that is supposed to be able to talk to you. The system is called PlayStation Assist.
- Thanks to a robot, you may never have to play alone again.
- The PS5 could give you tips for the best weapons or level duration.
What do you think about it? Would you like it if an artificial intelligence controlled the music of your game, and you might always hear the perfect music, or should the developers rather determine what happens?
Do you want to know more about the PlayStation 5 and what is currently known about Sony’s new console? Then check our overview. Here we have summarized all important information about the PS5 for you.
