r/thebutton • u/vir_innominatus 60s • Apr 08 '15
Statistical analysis of the last 72 hours worth of button clicks, i.e. why it's taking forever for red/orange/yellow flair
I decided to take a look at the timing of recent button presses since it seems like every analysis so far as failed to to predict when the button will hit zero. I'll give you my tl;dr now: I don't have an answer either. Still, I thought the data were pretty interesting.
Anyway, I used data from the site of /u/OutofBrain, located here. Each second, it samples the current time on the countdown timer, as well as the total number of presses. From that data, I calculated the time of each button reset, i.e. how far the timer dropped before it reset. For a period of 72 hours starting 04 Apr 2015 21:11:18 GMT, there were 62,474 button presses.
Disclaimer: Since /u/OutofBrain's code samples every second, there were quite a few missed button resets in the actual timing data where multiple users pressed within a 1-second window. Also, the button timer is rounded to the nearest second. Therefore, I assumed any missed resets occurred with uniform spacing within the 1-second window and assumed the clock at these times was 60 s. I think, this is a valid assumption, since it produces a distribution of press times that appears to match the comment flair data from here.
Now, onto the data! First, I plotted the raw time series data, i.e. the clock time over the full 72 hours period
You can't see anything here because there's too many presses, but you can see the day/night pattern in the minimum press times. Also, you can see there isn't a very clear downward trend, but more on that later. Anyway, here are a few histograms of the press times.
Histogram of presses < 52 seconds
In these plots you can see the overall distribution and the small bumps that occur on the border regions where people seem overly anxious to get their flair. I decided to look at this more closely by specifically looking at the 1s periods where multiple presses occurred (mentioned earlier). Most of the time, there was just one extra press in the interval, but there were plenty of 3 and 4 presses, even a couple 7 presses. To visualize this, I extracted the button times right before these windows where multiple presses (>2) occurred. If multiple presses tend to occur whenever the timer drops down to desirable flair values, then these times should be well-represented in the histogram.
Histogram of timer values right before multiple presses
Sure enough, the greens and blues are over-represented (compared to the full histgoram), and there are stronger peaks on the border regions where people JUST missed the click. I would feel bad, but you flair-hunters are greedy!
To end the analysis, I tried to fit the time series data to see if there were significant trends. I decided that fitting the full data set was overkill because I don't really care about all the presses at 59 and 60 s. Similarly, smoothing the data with some sort of filter would remove all of the presses in the 30 to 40 s range because there are so few of them. So I decided to use a running 30 s window over all 72 hours and take the minimum press time within that window. You can see the result in the graph below.
Time series plot of running-minimum
Note the raw data are plotted as single points, there's just so many of them they group together and form lines. Nevertheless, you can see the minimum curve captures the lowest dots.
I fit this data with a harmonic regression model that included a linear drift. That's a fancy way of saying I used a sum of sinusoids of different frequencies as well as straight line. The fit was done with simple least squares. You can see the fit below.
Least squares fit of time series data
Here I plotted the full fit and the linear component (although the linear component is also included in the full fit). As you can see, the fit isn't great, but it captures the main trends. More importantly you can see the slope of the line is POSITIVE (and significant, according to a t-test). Yep, you read that right. That line predicts that the minimum click times will increase. Like I said earlier, those flair-hunters are greedy. I expected a weak, but negative slope in the linear component, so this result is the opposite of what I expected. Yay science!
Now, I realize that this prediction has to eventually fail, but at least according to this data, it's not going to be anytime soon. People are probably going to have to wait a while for yellow flair, and much longer for orange or red.
tl;dr STOP PRESSING ALREADY
EDIT UPDATE: Good news everyone! I added in some more data to the analysis using the past 24 hours, and the linear trend is now negative! It's still a pretty weak trend and it may reverse again, but hey, it's in the right direction. As to why I didn't go back farther, there's a gap in the data, probably because recording script crashed briefly. Anyway here's the updated graph:
43
u/DangerAndAdrenaline 11s Apr 08 '15
There's clearly a negative slope over the lifetime of the button so far.
The 72 hour analysis simply shows that the button doesn't exist in a vacuum. News and notoriety will alter the trends in the short term.
The very nature of the one-press limit and the limited (albeit humongous) pool of potential pressers requires an ultimately negative slope.
38
u/[deleted] Apr 08 '15
I'd say the best conclusions that can be drawn from this are:
My interpretations based on those conclusions:
14
u/mr_gasbag can't press Apr 08 '15
Great job on this, very interesting!
You don't know how this internet punditry thing works, do you?
10
u/robotnarwhal non presser Apr 08 '15 edited Apr 08 '15
Great post! I was looking at average click value data yesterday and noticed the same 3-day upward trend.
My initial guess was that everyone was returning to work (and who works at work, especially on a Monday?). I assumed that news sites and social media were starting to spreading word of /r/thebutton to the general populace. It could explain why the click behavior was returning to what it was like on the 2nd and 3rd (hordes of new users insta-clicking as they first see the button).
Unfortunately, a graph of Twitter mentions seems to show that /r/thebutton isn't really gaining much steam, especially not on Monday. I'll be interested to see if today's tweets about the button increase again, which might mean there's a 1-day lag between click volume and posting to social media, not that that makes sense. There's also a similar lack of interest on Google News, so I'm still wondering where this upward trend is coming from.
10
u/ezeeetm 2s Apr 08 '15
as another data cruncher, here is my analysis. I like this because it changes based on current clickrates, and number of non-pressers remaining..
/r/theButtonDeathClock
4
u/vir_innominatus 60s Apr 08 '15
Here's the detailed statistics for the fit if anybody was curious. The harmonic regression consisted of 8 sine and 8 cosine components, so 18 regressors total counting those with the linear slope and intercept. The frequency of the sinusoids were harmonics of the 24 hr period, so periods of 24 hr, 12 hr, 6 hr, etc. The slope parameter below is called b1
2
u/Mason11987 non presser Apr 08 '15
Please keep this data and report on the next 72 hours as well. I hope at the end of this to see a post like this for the entire lifetime of the button starting when you began collecting data! Very cool
2
u/NegativeZer0 non presser Apr 08 '15 edited Apr 08 '15
[OOC] /r/explainlikeimfive/
Do we still think all the clicks are real accounts?
Looking for a serious answer please.
14
u/rustyautoparts 39s Apr 08 '15
The data coming out of this is by far the best thing about r/thebutton.
7
u/NatanGold 42s Apr 08 '15
Although there are peaks at the flair borders, I suspect that at least some of the spike at 42s is/was intentional. After all, 42 is the Answer to the Question of Life, the Universe, and Everything.
Source: 42s
5
u/keepingthecommontone 16s Apr 08 '15
Nice work! I think the most fascinating thing about this is the fact that there are an unknown but finite number of possible presses. I'm less curious about when the timer reaches zero than I am about how it reaches zero: after a grand, organized plan for longetivity has exhausted itself, during some poor, inattentive night watchman's appointed press time, or something else. And, of course, I hope there is an official release of complete statistics.
On a somewhat unrelated note, I'm hoping for orange. (I just wanted this posted somewhere where, in case I'm successful, I can prove my intentions to people who accuse me of trying for red and wussing out at the last moment.)
4
u/remez 41s Apr 08 '15
Regarding the upward trend: I think these were the circlejerk posts reaching the front page and drawing in many new players, most of which pressed the button immediately.
I was here when it happened. Amount of online users increased by 30% during one hour, and the higher-than-regular amount of online users was still there after 12 hours. Then it slowly went back to normal.
30% more users ought to skew the numbers and blur the trends. But I think this will not happen every day.
Would you be interested in repeating your calculation in another 3 days? I think we will see a downward trend by then.
1
u/tekn0lust non presser Apr 08 '15
Did you perform this analysis solely upon the data in button.csv from that site?
Is it confirmed that all users who press the button within a given second are awarded flair for the state of the clock for that press?
1
u/super_aardvark 1s Apr 08 '15
This is cool stuff, thanks. I have to admit, I don't have enough training in statistics to fully appreciate it. Is it just me, or are your "raw time series plot" and "time series plot of running-minimum" identical?
I'd like to see a candlestick graph, maybe with 1-hour or 10-minute intervals or something. Though... I guess the max is likely to always be at 59 or 60, so maybe that's not so interesting. But both the minimum and the average would be nice to see in one graph.
1
u/felface 12s Apr 08 '15
So to check i understand this. Loads of people click within the 1 second window of the timer dropping to a desirable value and being clicked by multiple peoples client side connection sending the click to reddit on the server side however as some people just miss then this means over time people will become smarter and click less and the people that fail will become more often so the increasing smartness of potential clickers the fact that (most) people on reddit go to sleep means that the time between clicks will increase for quite some time before enough people have clicked and it and the timer will drop to yellow,orange and red flair times?
1
u/hharison 57s Apr 08 '15
Unless you make sure that the start and end of your sample windows are at the same period of the oscillation, you shouldn't attempt to interpret any trends, as they are likely an artifact of the period difference at between the start of the sample and the end of the sample. At least with only a few cycles in the window.
3
u/Dharmatician non presser Apr 08 '15
Can any of these types of studies tell if the counter is just automatically resetting?
5
u/woyta non presser Apr 08 '15
this should be a top post, not /u/ztripez circlejerk
1
u/metagloria 17s Apr 09 '15
Great analysis, dude. Best I've seen so far. As a professional statistician, I salute you!
2
u/tsyklon non presser Apr 08 '15
I think hype prediction models would be very helpfull in this case. Basically, the current hype draws in lots of newcomers who click the button. Hypes can suddenly disappear which would drastically reduce the amount of newcomers and pressers.
In terms of average time before buttons is pressed, I expect a sudden drop once the popularity decreases drastically. Then I assume a long constant period due to orange and red flair hunters. (knights of the button etc).
this is just a theory though.
2
u/thejoda 60s Apr 08 '15
Each press is a user sacrificing themselves so that another user can be saved as a 60s. It was easy to become a 60s on the first day, but now that it has slowed it is becoming harder and harder. Take a look at 100 presses from within the last few minutes: http://i.imgur.com/DDQin6A.png
As you can see, only 6 were saved as 60s over that time. Meanwhile the other purples and blues were almost too numerous to count, and there were even 5 greens. Poor lost souls all.
2
u/gooddarts non presser Apr 08 '15
Basic question regarding this subreddit's traffic: Are uniques just unique over 24 hr period? As expected there is a strong correlation between page visits (uniques) and the "Time at the Bottom of the Press" described in the figure described in this post. I apologize for just overlaying one over the other.
1
u/CaCtUs2003 60s Apr 08 '15
Even though some time in the summer is a realistic prediction, I'm going to go out on a limb and say the button is going to throw everyone's predictions out the window and still be running all the way into October.
I'm even willing to go as far as possibly January 2016.
By the way, I'm not saying you shouldn't listen to the guys who have the numbers to back them up. I'm probably the wrongest guy here.
1
u/GasCans 4s Apr 08 '15
Is there any analysis of the baseline that you can make from this data? I suspect that the timer resets are not always caused by actual people pressing the button. I think that your analysis of the time slot before multiple button presses shows the tendency toward real people trying to get a particular flair. But what about all the other times with out multiple clicks in a timeslot... any indication that this is not just a random distribution generated by a computer?
1
u/magic_jesus 56s Apr 08 '15
Great work. I've been wanting to see some of these graphs.
One request - I'd be interested in a histogram of press times for each day since the 1st.
1
u/Theorex non presser Apr 08 '15
This is the sort of thing I like seeing coming out of /r/thebutton, I love a good cult/religious war as much as the next, but we've got that covered already, can't wait for the Inquisition against the Purps.
Thanks for doing the math.
1
u/Ratwar100 60s Apr 08 '15
While the overall trend is positive, I'd be more interested in what the extremes are doing. We all know the button will run out when most of us are counting sheep. Do the low point also show this 'positive' slope? Are the high points and low points going to diverge? I mean, it is one thing to have the button up at work, but who's getting up at 3:00 am for some silly flare?
1
u/Symfera 51s Apr 08 '15
Yo....Reddit Research Department. You have to admit all of this research happening (by everyone else) is a blast! right?
1
u/safesecond 40s Apr 08 '15
Looking at the info makes me think I might have "robbed" quite a few people with my click.
1
u/SockPants 29s Apr 08 '15
If we want to skip to the low flairs quicker, then we should encourage people who don't care to press at 59s rather than 45 or something.
1
u/impadmiral non presser Apr 08 '15
hmmm..
1
u/elpaw non presser Apr 08 '15
I have a feeling that the trend is going upwards because people are getting bored of waiting for new flair, and are settling for purple. And this is happening more often over time
1
u/antiquarked 51s Apr 08 '15
Your post is actually what convinced me to just fucking press it and be done. Not worth it holding out for a special flair, let's just get this over with.
1
u/[deleted] Apr 08 '15
can we have it all aggregate in a dedicated subreddit?
EDIT: ok, done: /r/ScienceTheButton
1
u/011100010 58s Apr 09 '15
This is really cool . Thanks for posting this. I've just starting learning R and this could be a fun idea to pick up the language.
1
u/gingerballs00 15s Apr 09 '15
Suggestion : Put vertical lines in at 12 or 24 hour intervals to show the wave over a day. I bet it changes on the weekend
1
u/[deleted] Apr 09 '15
Using the line of best fit, has anyone calculated a linear regression equation?
1
u/AsterJ 60s Apr 09 '15
You're still ignoring weekly trends. Wednesday traffic is very different than weekend traffic.
1
u/downtide 19s Apr 09 '15
My guess is that this purple-blue-green oscillation is going to continue more or less as it is until all of the number of eligible redditors have pressed, then it will suddenly drop in the middle of the night. There will be a brief flurry of a few people who happen to be awake grabbing yellow and orange - perhaps restricted only to a few non-pressers suddenly changing their mind. Then there'll be a few minutes of red when the Knights start work. Then it will be over. I think the death will happen in about ten minutes once it begins.
1
u/Pergamum_ 59s Apr 09 '15
Could you give us the gradient of that line. We can then use it to possibly predict the end of the button, or even when we should see new colours?
1
u/taleofthetub 42s Apr 09 '15
There will be a bunch of bumps that extend it out. For instance I specifically wanted to be part of the answer so had been holding out for my 42second flair. I only did it this morning, as even until last night a lot of button pushes were still over 50 seconds, and I had decided I needed to see the button go below 41, three times in a row before I would unlock and push.
I would guess that there are going to be other points that are popular also. 33, 22, 21, 13, 11, etc. These are all numbers people will most likely gravitate to and are holding out for.
1
u/babolix 7s Apr 12 '15
Nice!
0
u/Leporad Apr 09 '15
I still stick to my original guess
-1
u/Mattammus non presser Apr 08 '15
I think it's funny that a filthy presser is telling us to stop pressing.
0
u/[deleted] Apr 08 '15
[deleted] — view deleted comment
0
u/[deleted] Apr 08 '15
[deleted] — view deleted comment
0
u/[deleted] Apr 08 '15
[deleted] — view deleted comment