Spotify, I choose you

Spotify, I choose you

We chose Spotify for this evaluation because it’s a widely-used platform that transformed music access and social interactions through shared listening. Spotify’s pioneering social features allow users to connect, discover new music, and collaborate on playlists, which aligns with our interest in studying user experience in music-sharing communities. Its large user base and frequent updates make it relevant for assessing design choices on usability and social engagement, as well as exploring areas for enhancing user satisfaction.

We chose Spotify for this evaluation because it’s a widely-used platform that transformed music access and social interactions through shared listening. Spotify’s pioneering social features allow users to connect, discover new music, and collaborate on playlists, which aligns with our interest in studying user experience in music-sharing communities. Its large user base and frequent updates make it relevant for assessing design choices on usability and social engagement, as well as exploring areas for enhancing user satisfaction.

Who's on aux?

Who's on aux?

Understanding User Needs

Understanding User Needs

User interviews were conducted to understand the in-depth pain points faced by users.

  • Our demographic was based on convenience and consisted of college students only.

  • Participants had between 3 and 11 years of experience using Spotify.

  • All of the interviewees used Spotify Premium.

User interviews were conducted to understand the in-depth pain points faced by users.

  • Our demographic was based on convenience and consisted of college students only.

  • Participants had between 3 and 11 years of experience using Spotify.

  • All of the interviewees used Spotify Premium.

Picture of Affinity Mapping
Picture of Affinity Mapping

Codes Generated from Affinity Mapping

Codes Generated from Affinity Mapping

Problems

Problems

📲

Only Option for Sharing Music is via Third-Party Apps like Instagram or Facebook

🔁

No Option to Share Songs Within the App, Requiring Users to Switch Apps

Confusing Navigation for Downloading Music and Slow Content Loading

🎧

Lack of Song Previews Complicates Playlist Management

Tedious Process of Adding Songs from “Now Playing” to Existing Playlists

📱

Poor Playlist Management on Mobile Devices

🔁

No Option to Share Songs Within the App, Requiring Users to Switch Apps

Confusing Navigation for Downloading Music and Slow Content Loading

🎧

Lack of Song Previews Complicates Playlist Management

Tedious Process of Adding Songs from “Now Playing” to Existing Playlists

📱

Poor Playlist Management on Mobile Devices

🔄

Steep learning curve of algorithms with repetitive song recommendations

🔁

No Option to Disable Smart Shuffle, Songs End Abruptly at Queue's End

So who are we designing for?

So who are we designing for?

Manny Delgado

👨‍🦱

Age/Gender

23/Male

🎓

Occupation

Student

📍

Location

New York, USA

📍

Location

New York, USA

"Music sets the vibe, and I'm here to make sure it's always fresh and full of energy. I’m always on the lookout for new music that I can share with my friends."

Goals

  • Stay connected with friends through Spotify's social features.

  • Discover new music that aligns with their taste, via social media and Spotify’s features.

Behaviours

  • Discovers new music primarily through social media and music charts.

  • Creates multiple playlists, collaborates with friends, and enjoys seeing what others are listening to.

  • Likes sharing music and his opinions about it with the world.

Frustrations

  • Finds the music recommendations basic and repetitive, with an algorithm that tends to favor short-term preferences.

  • Wishes for a more personalized playlist creation feature that focuses on new music, not songs they’ve already heard.

  • Difficulty managing playlists on mobile, such as rearranging songs and accessing smart shuffle settings.

Integrations

  • Uses Instagram Stories to share music with everyone.

  • Uses Apple Messages to share music personally.

  • Posts music with every story on instagram to make it more engaging.

How well do you know your music?

How well do you know your music?

📲

Only Option for Sharing Music is via Third-Party Apps like Instagram or Facebook

🔁

No Option to Share Songs Within the App, Requiring Users to Switch Apps

Confusing Navigation for Downloading Music and Slow Content Loading

🎧

Lack of Song Previews Complicates Playlist Management

Tedious Process of Adding Songs from “Now Playing” to Existing Playlists

📱

Poor Playlist Management on Mobile Devices

🔄

Steep learning curve of algorithms with repetitive song recommendations

🔁

No Option to Disable Smart Shuffle, Songs End Abruptly at Queue's End

To understand better the struggles of our users, we conducted a Think Aloud session with the following three tasks and measured user performance based on metrics.

To understand better the struggles of our users, we conducted a Think Aloud session with the following three tasks and measured user performance based on metrics.

Adding new songs to their playlist

Adding new songs to their playlist

🫂

🫂

Finding their friends and finding their music activity

Finding their friends and their music activity

🔃

🔃

Rearranging/organizing their playlists

Rearranging/organizing their playlists

The following metrics were considered for the Think Aloud Observations:

The following metrics were considered for the Think Aloud Observations:

➕❌

Error Rate

Error Rate

👆

👆

Number of Clicks

Number of Clicks

🕐

🕐

Time on Task

Time on Task

🤩

🤩

Satisfaction

Satisfaction

  • Participants struggled with locating friend profiles and using features due to inconsistent design and unclear instructions.

  • Confusion over friend search functionality, ambiguous icons, and too many steps to complete simple tasks.

  • A standard deviation of 36 seconds for finding a friend’s profile, indicating a significant difference between experienced and novice users.

  • Participants struggled with locating friend profiles and using features due to inconsistent design and unclear instructions.

  • Confusion over friend search functionality, ambiguous icons, and too many steps to complete simple tasks.

  • A standard deviation of 36 seconds for finding a friend’s profile, indicating a significant difference between experienced and novice users.

Confidence Intervals for Problem Detection

Confidence Intervals for Problem Detection

In our usability evaluation, confidence intervals provide insights into the likelihood that users will complete specific tasks successfully. A confidence interval represents the range in which we expect the true task completion rate to fall, based on our sample of users.

In our usability evaluation, confidence intervals provide insights into the likelihood that users will complete specific tasks successfully. A confidence interval represents the range in which we expect the true task completion rate to fall, based on our sample of users.

Task 1: Add a new song to your most used playlist from the 'Now Playing ’ screen.

Task 1: Add a new song to your most used playlist from the 'Now Playing ’ screen.

🎯

100%

100%

Completion

If we repeated this study many times, the true completion rate would fall between 92.86% and 100% in 95% of those cases.

The likelihood that at least 70% of all users could complete this task is 99.31%.

Task 2: Navigate to your friend's profile, find a song/playlist your friend is listening to, and add it to your library.

Task 2: Navigate to your friend's profile, find a song/playlist your friend is listening to, and add it to your library.

🎯

83%

83%

Completion

If we repeated this study many times, the true completion rate would fall between 78.57% and 96.50% in 95% of those cases.

The likelihood that at least 70% of all users could complete this task is 83.11%.

Task 3: Within your playlist, group 2 songs together from the same album.

Task 3: Within your playlist, group 2 songs together from the same album.

🎯

50%

50%

Completion

If we repeated this study many times, the true completion rate would fall between 50% and 74.62% in 95% of those cases.

The likelihood that at least 70% of all users could complete this task is 7.82%.

🔀

Users found grouping and rearranging songs tedious and unintuitive.

A 57% error rate was discovered among users trying to rearrange songs in their playlists.

A standard deviation of 36 seconds was found in the time taken to locate a friend's profile indicating expert vs novice use.

😡

The average satisfaction while rearranging their playlists was 2/5 indicating a bad experience.

👆

The average number of clicks to find a friend's profile was 13.25 with some users needing up to 25 clicks.

🤔

User behavior while rearranging songs in their playlist differed from the existing model.

Critical Issues Discovered during the Interviews

Critical Issues Discovered during the Interviews

🔀

Users found grouping and rearranging songs tedious and unintuitive.

A 57% error rate was discovered among users trying to rearrange songs in their playlists.

A standard deviation of 36 seconds was found in the time taken to locate a friend's profile indicating expert vs novice use.

😡

The average satisfaction while rearranging their playlists was 2/5 indicating a bad experience.

👆

The average number of clicks to find a friend's profile was 13.25 with some users needing up to 25 clicks.

🤔

User behavior while rearranging songs in their playlist differed from the existing model.

Probability of Detection of Issues with 5 Raters

Probability of Detection of Issues with 5 Raters

The probability of detection helps determine how likely usability issues are to be uncovered by a specific number of participants. This metric ensures that the most critical issues are identified early, enabling teams to prioritize improvements effectively and allocate resources efficiently.

With the help of a probability of detection matrix, we discovered that the percentage of issues that would be discovered with just 5 users would be 99.67%.

System Usability Scale (SUS)

System Usability Scale (SUS)

To measure the overall user satisfaction with Spotify’s interface, we administered a System Usability Scale (SUS) survey. SUS is a standardized tool widely used for evaluating usability across products, generating a score from 0 to 100. Scores are typically compared against an industry benchmark of 70, where a score above 70 indicates good usability, while scores below suggest areas for improvement.

We used statistical tests to assess whether Spotify’s mean SUS score significantly differed from this benchmark.

🎯

🎯

53.13

53.13

Average SUS Score

Average SUS Score

70

70

Benchmark SUS

Benchmark SUS

Standard or target score.

Standard or target score.

17.84

17.84

Standard Deviation

Standard Deviation

Variation from average score

Variation from average score

99%

99%

Confidence

Confidence

Certainty in result range.

Certainty in result range.

-3.27

-3.27

T-Value

T-Value

Measures difference from benchmark

Measures difference from benchmark

Reflection

Reflection

Key Findings

Key Findings

Music Discovery and Recommendations

Spotify’s recommendation system needs improvement, as users find it repetitive and seek more personalized suggestions.  Users rely on social media and friends for new music, especially for niche or emerging artists.

Playlist Management

Playlist organization is difficult due to a lack of intuitive features. Users want a more seamless way to group and move songs within playlists.

Social Features

Users enjoy collaborative playlists but find accessing friends’ profiles and activity confusing and inaccessible.

Design Recommendations

Design Recommendations

how to fix the problems we found

  • Simplify playlist workflows by enabling drag-and-drop song rearrangement and quick playlist assignment options.

  • Introduce a dedicated Friends tab to make social interactions like activity tracking and playlist sharing more accessible.

  • Holding the plus button on the Now Playing screen could display a pop-up that lets user quickly select the playlist they want to add the song to.

  • Provide song previews for easier playlist organization and encourage discovery within the platform.

Design Opportunities

Design Opportunities

what else can be done to elevate the experience

Including a "social" section where users can share songs they are currently listening to with all their friends would allow for better discovery and engagement within the app.

  • Similar to Soundcloud, users wished to be able to comment on specific sections of songs to share their thoughts.

  • Collaborative playlists are popular but have limited flexibility and engagement features. Adding options like real-time playlist updates or liking songs for the collaborators to see could make sharing music with friends more dynamic and interactive.

  • Lyrics for songs in foreign languages can be displayed in romanized english making it easier for non-speakers to sing along increasing global reach for artists.

That's the end of this one.

Wanna see another?

That's the end of this one.

Wanna see another?