Prediction Analysis 2021

Wow! What a killer line up the Hottest 100 of 2021 was! Triple J really mixed things up this year by playing the Hottest 200 the day before the Hottest 100. This gave us an upper hand to improve our predictions, by allowing us to eliminate songs from the Hottest 100 which had ranked in the Hottest 200 on the previous day. In doing so, we managed to take our top 100 prediction accuracy from 73% to 82% of the top 100 songs.

As per usual, this year we continued to collect data across the following five sources:

  • Instagram Posts
  • Instagram DMs
  • Instagram Stories
  • Twitter Posts
  • Reddit Comments

Summary

  • We collected 2,855 entries (41% decrease since 2020 🔻)
  • We tallied 25,877 votes across these entries (39.7% decrease since 2020 🔻)
  • triple j counted 2,500,409 votes.
  • Therefore, we collected a sample of 1.04%.
  • We successfully predicted #1
  • We predicted 8 out of the top 10 songs.
  • We predicted 14 out of the top 20 songs.
  • We predicted 82 out of the top 100 songs played in the countdown.
  • Throughout December and January, 100warmtunas.com was loaded over 182,000 times by 54,000 users.

Once again, despite collecting less data than previous years, we still maintained a relatively stable sample size of about 1%. This was due to the actual submitted vote count as reported by triple j also decreasing from 2,790,224 to 2,500,409.

Technical Analysis

This year, we were successfully able to predict #1 (Elephant [triple j Like A Version 2021] - The Wiggles) to win. Lets take a look at the top 10 of the official countdown and match it up with the predicted places in 100 Warm Tunas:

ArtistTitleABC RankTunas RankDifference
The WigglesElephant [triple j Like A Version 2021]110
The Kid LAROI & Justin BieberStay231
Spacey JaneLots Of Nothing374
Olivia Rodrigogood 4 u440
Billie EilishHappier Than Ever594
Gang Of Youthsthe angel of 8th ave.624
Doja CatKiss Me More [Ft. SZA]752
Lil Nas X & Jack HarlowINDUSTRY BABY8135
RÜFÜS DU SOLOn My Knees963
Lil Nas XMONTERO (Call Me By Your Name)10188

Lets pull apart this table a bit more and grab some statistics about how we did with our prediction overall:

PredictedOut Of Top NPercentage
81080.0%
142070.0%
203066.7%
284070.0%
35 (*34)5070.0%
43 (*42)6071.7%
52 (*49)7074.3%
62 (*55)8077.5%
72 (*61)9080.0%
82 (*73)10082.0%
15220076.0%

From the above data, we can see that:

  • The average error for the top ten ranks was about 3 positions (about the same as 2020 and 2019).
  • Warm Tunas predicted 8 out of the top 10 songs.
  • Warm Tunas predicted 14 out of the top 20 songs.
  • Warm Tunas predicted 84 out of the 100 songs played in the countdown.

(note, asterisked values represent prediction without top 200 elimination)

To compare Warm Tuna's predictions vs actual rankings, a scatter plot has been provided below. We can see as we get closer to rank 1, the 100 Warm Tunas prediction gets better and converges upon the actual rankings played out on the day:

Accuracy of Predicted Ranks

Making exact predictions is difficult, especially when you only have a small fraction of the data. The data will generally give you a good indication, but will never allow you to predict, with certainty, that a particular outcome will occur. This is the reason we implemented confidence intervals on our predictions for the top 10.

The following tables depict the range of error exhibited across different cross-sections of the countdown.

Accuracy of the Top 10:

Positions OffNum Occurences%Positions Off (Cumulative)OcurrencesCumulative %
0-4880%0-4880%
5-9220%0-910100%

Accuracy of the Top 20:

Across the top 20, 75% of our predictions were accurate within 9 places of their actual position in the countdown.

Positions OffNum Occurences%Positions Off (Cumulative)OcurrencesCumulative %
0-91575%0-91575%
10-1915%0-191680%
20-2915%0-291785%
30-3915%0-391890%
60-6915%0-691995%
Did not rank15%---

Accuracy of the Top 50:

The trend continues across the top 50, with 48% of our predictions being accurate within 9 places of their actual position in the countdown and 74% being accurate within 29 places. This shows that 100 Warm Tunas is still reasonably good at predicting a general idea of what songs will play during the countdown.

Positions OffNum Occurences%Positions Off (Cumulative)OcurrencesCumulative %
0-92448%0-92448%
10-19714%0-193162%
20-29612%0-293774%
30-3936%0-394080%
40-4924%0-494284%
50-5912%0-594386%
60-6924%0-694590%
70-7912%0-794692%
> 8024%> 04896%
Did not rank24%---

Accuracy of the Top 100:

For completeness, the accuracy bands of the top 100 have also been provided

Positions OffNum Occurences%Positions Off (Cumulative)OcurrencesCumulative %
0-93232%0-93232%
10-191717%0-194949%
20-291111%0-296060%
30-3999%0-396969%
40-4999%0-497878%
50-5955%0-598383%
60-6955%0-698888%
70-7911%0-798989%
> 8044%> 09393%
Did not rank77%---

Vote Source Breakdown

100 Warm Tunas collects votes from a handful of different sources. Here is the break-down of how many votes were counted across the different sources:

SourceNum EntriesNum VotesVotes Per Entry
Instagram Feed2235205319.1861
Instagram DM48144749.3015
Instagram Story85972388.4261
Twitter48041508.6458
Reddit13712048.7883
Total4192375978.9688
Total (after de-duplication)4026361568.9806

Vote Submissions

The most popular day for people to share their votes was the day before voting closed, with a spike of 344 entries collected, followed by the day after voting opened with 260 entries collected. We also observed a slight spike on the eve of Hottest 100 Day:

Our quietest day is observed to be Christmas day with only 6 submissions collected.

We can break down the votes collected for each song over time:

Wrap Up

This year, whilst picking the outright winner was a key highlight, we are most excited about being able to successfully predict 8 of the 10 of the songs which landed in the top 10. We believe this is the most important metric rather than exact positions. With the declining amount of data available, it’s getting harder and harder to pick the outright winner with certainty.

We'd like to thank everyone who shared their votes, visited our site or interacted with us on Instagram. Without our audience, 100 Warm Tunas wouldn't be possible. See you next year!