UC Berkeley researchers used machine learning to analyze more than 5,000 Billboard Hot 100 hits, finding that storytelling has been on the uptick since the 1990s thanks to the rise in popularity of hip-hop.
Think of the lyrics of your favorite pop song. Are they like Taylor Swift’s “All Too Well,” which narrates the story of a breakup, jumping back and forth in time and building a world through vivid descriptions of past memories? Or are they more like David Bowie’s “Fame,” which evokes feelings and impressions conjured by the phenomenon of fame rather than telling a story?
To understand the role of storytelling in contemporary pop music, researchers at UC Berkeley created a machine learning algorithm that can identify narrative storytelling elements in song lyrics. In a new study, they used this algorithm to analyze more than 5,000 pop songs that made the annual Billboard Hot 100 list between 1960 and 2024, charting how storytelling in popular music has changed over the past 60 years.
“We wanted to see if computational methods could measure the stories that are present in songs in order to help us understand how storytelling in music has changed on a larger scale over the past half of a century,” said study first author David Bamman, an associate professor in the School of Information at UC Berkeley.
The analysis revealed some interesting trends. One might expect that storytelling in pop songs peaked in the 1960s, when ballad-driven folk singers like Joan Baez, Bob Dylan and Simon & Garfunkel regularly topped the charts. However, the researchers found that narrativity in songs has actually been on the uptick since the 1990s. This is due in large part to the rise in popularity of hip-hop, which is rife with narrative and storytelling.
For example, Ice Cube’s “It Was a Good Day” was ranked the fifth most narrative of all the songs analyzed, right ahead of Taylor Swift’s “All Too Well,” which came in sixth. The lyrics narrate a day in the life of the rapper who is trying to find romance and connect with friends while surviving racism and police surveillance in South Central Los Angeles.
“Many of us are excited about the computational modeling of cultural data because it grounds some of the claims that can be made from a smaller set of examples. When you have this larger set of data, you can get a picture of literary changes or developments that are clarifying and often go against the prevailing wisdom in that field,” said study corresponding author Tom McEnaney, an associate professor in the Departments of Comparative Literature and Spanish & Portuguese at Berkeley and director of the Berkeley Center for New Media.
Literary theorists have traced the evolution of literature and song from the Greek poets Homer and Sappho to 19th-century romantic balladeers, with some asserting a distinction between “ballads,” which they see as a form of storytelling, and “lyric poetry,” which they see as an expression of immediate emotions or impressions.
But while the poetry of Sappho and Yeats may be timeless, it likely didn’t make anyone’s Spotify Wrapped this year. Until now, few researchers have studied how storytelling appears in the pop music that makes up the soundtrack of our everyday lives.
“There was this assumption that poetry gets into popular music through hip-hop, and that hip-hop is the most lyric of genres,” McEnaney said. “If literary theory also tells us that lyric is non-narrative, then we wouldn’t expect to find hip-hop as the main driver of narrativity in popular music. But when you get to the 1990s, you just see the narrativity score shoot through the roof. This turns on its head the last 30 years of literary approaches to hip-hop.”