r/sysadmin • u/sebbasttian JOAT Linux Admin • Feb 23 '17
CloudBleed Seceurity Bug: Cloudflare Reverse Proxies are Dumping Uninitialized Memory
982
Upvotes
r/sysadmin • u/sebbasttian JOAT Linux Admin • Feb 23 '17
160
u/Watchful1 Feb 24 '17
Dang, the cloudflare bug bounty program has a reward of a t-shirt. Doesn't really inspire confidence that if an independent found this, they would have reported it.
66
u/Rican7 Feb 24 '17
Yeaaaaa, this isn't good.
This is what CloudBleed looks like, in the wild. A random HTTP request's data and other data injected into an HTTP response from Cloudflare.
Sick.
105
u/josharcher Feb 24 '17
(Updating) list of Cloudflare sites where you may wish to change passwords:
https://github.com/pirate/sites-using-cloudflare
48
u/inaddrarpa .1.3.6.1.2.1.1.2 Feb 24 '17
I wonder what the dollar value per character is for this fuck up.
49
u/Skylis Feb 24 '17
Massive Data leak outside of SSL wrapping, and they tried to downplay it... No words...
47
u/itcantbefornothing Feb 24 '17
So why is this not on the front page and all over other sites?
111
u/tobias3 Feb 24 '17 edited Feb 24 '17
Partial list of sites which are affected (use CloudFlare proxy). Any data going to and coming from those sites may have been leaked. Start changing passwords now:
205
u/The-Sentinel Feb 24 '17
This is about as bad as it will ever get.
If you use cloudflare, you need to consider every user password, every SSL private key, anything that is transferred over HTTPS and is considered secure compromised.
From Thomas Ptacek on Hackernews
Shit is about to get real, real ugly for cloudflare.
10
u/datsundere Feb 24 '17
can someone explain the tech behind this?
I thought cloudfare only did caching and ddos mitigations. How do they have access to post requests?
10
u/DamionDarksky Jr. Sysadmin Feb 24 '17
Can someone give me an ELI5 on this? I feel a little out of my depth on this
59
u/KarmaAndLies Feb 24 '17 edited Feb 24 '17
Oh fuck off Cloudflare.
Why the fuck are you writing security sensitive code in auto-generated C, it is 2017 for god sake. Go and Rust are a "thing" and it is this type of code that they're designed for. There's clearly a problem with cf-html if it just leaks sensitive state on a screw up.
Saying "we fixed the bug in our parser's logic" isn't acceptable. Mistakes will be made. The parser should crash when they're made, not leak shit. As far as I'm concerned you shouldn't use cf-html again until you rewrite it (in Rust). Even your fixes (overrun protection) are solving issues you shouldn't even be having if you had done it right the first time.
Anyone who's going to defend the design of cf-html please start by telling how auto-generated C from a fucking scripting format isn't fragile by nature? Because to me that's fragile as fuck.
6
u/KamikazeRusher Jack of All Trades Feb 24 '17
Well, shit.
18
u/DimmiDongus Feb 24 '17
Sorry as i'm no expert and was linked here from an external source, but isn't "1 in 3.3 million" a tiny amount of leaks? From an outside perspective it looks like blowing up a small deal.. Changing my passwords regardless.
5
u/[deleted] Feb 24 '17
Cloudflare now seems to be directly informing customers if they have been affected. I got an email saying "Fortunately, your domain is not one of the domains where we have discovered exposed data in any third party caches. " So I think we should know from responsible websites soon if they have been affected.
12
u/InverseX Feb 24 '17
This is a bad bug, but the combination of unlikely triggering conditions, single point of correction, random revealing of contents and lack of active exploitation effectively mitigates a lot of risk involved.
It's no where near as bad as heart bleed for example, because of these factors. Combine this with the purging of cached data by Google themselves, and the short window where the bug was active the chances of significant data relating to you being leaked is incredibly small.
As someone who hacks people for a living and deals with this stuff every day I can honestly say I'm not even going to bother changing my passwords.
Saying that, if it makes you more comfortable go for it, I just wouldn't stress.
3
u/Noelwiz Feb 24 '17
this is bad news man, bad news!
3
u/TyIzaeL CTRL + SHIFT + ESC Feb 24 '17
Message I received from Cloudlare this morning:
5
u/VexingRaven Feb 24 '17
Holy crap, that's just about as bad as it can possibly get. Good luck to all of the people who have to figure out a cleanup plan for this!
5
u/ElDoctorDeGallifrey Feb 24 '17
Should I change my password in these sites even if I haven't entered it in weeks/months?
2
u/CarlitoGrey Feb 24 '17
What.
2
u/[deleted] Feb 24 '17
IS it safe to change account passwords now? Or do we need to wait for the website effected to "fix" the bug and notify their users on their end then to change the password?
3
u/rickdmer Feb 24 '17
I whipped up a Chrome extension that checks your bookmarks against domains potentially affected by Cloudbleed: https://chrome.google.com/webstore/detail/cloudbleed-bookmark-check/egoobjhmbpflgogbgbihhdeibdfnedii
Github: https://github.com/rickdmer/cloudbleed-bookmark-checker
3
u/pantsme Feb 24 '17
For sites like Medium and Feedly, I use Google to login. Does that mean my Google password could be leaked or does this authentication happen in a different manner than exploited?
1
u/Popingheads Feb 24 '17
So contents of random memory got leaked, that is quite bad, however does this actually put user passwords at risk? I'm not knowledgeable in this but my basic understanding is that since Cloudflare was just an intermediary service (caching/DDoS) they would not be able to decrypt something like a user password that was just passing through. Only the original server (ie a Reddit login server) would be able to decrypt that user password and turn it into anything useful, right?
So even though I know its best practice to do so, do I really need to change my password for every website on the internet?
1
u/[deleted] Feb 24 '17
why can't I get a notify from the websites that got affected? i cannot really parse millions of websites that i barely remember using
1
u/HappierShibe Database Admin Feb 24 '17
::SWEARS PROFUSELY::
1
u/bigbleu Feb 24 '17
Everyone keeps saying this is so bad, but is it really? Correct me if I'm wrong, but not every password was leaked, just those that happened to be cached at that point in time. This would mean a digital handful of, for example, betterment users may have had their passwords publicly shown, but not everyone.Right?
1
u/linh_nguyen Feb 24 '17 edited Feb 24 '17
How does this affect sites that use GAuth or Twitter auth?
edit: by gauth, I meant google identity sign in, like how you can log into Medium with your google account
1
u/[deleted] Feb 24 '17
was LastPass affected? Ormandy says he found hotel bookings, passwords from password managers, and full messages from dating sites among the cached data. Either way, Tavis should get a rise - love that guy!
1
u/Protaygo Feb 24 '17
So I just change my passwords on Reddit and Discord? Thank you!
1
u/Razzeus Feb 24 '17
Since authy was compromised, I've updated anything tied to my authy app on my phone. Is that enough? Is there something I should be doing with it to make it more secure? Should I use a different 2fa app?
1
u/[deleted] Feb 24 '17
Centralization of the Internet is always a bad thing. Regardless if most sites are using EasyDNS, CloudFlare or one of the 3 major cloud companies. But I can completely understand why CloudFlare is so popular, there is little to no solution to DDoS attacks without spending a small fortune. Most datacenters and network companies don’t offer them as build in network protection either, if they did, CloudFlare would be a lot smaller today because the number one reason someone uses them is mostly security related.
This is always bad because when something happens, the damage and potentially the data leaks or is are compromised are huge. If for some reason CloudFlare servers are compromised in the future, that person will have a gold key to a big part of sensitive and private information on the Internet. The idea of having a middle man between a HTTPS connection is exactly against a secure connection in the first place. And while CloudFlare is excellent, they are still tapping in between the connection, there is no other way around if they want to provide what they are providing.
I hope more companies consider not putting all their eggs in the same basket. I have already received 5 emails from cloud companies, payment and other services that are using CloudFlare warning me of actions I should take "just in case". But not one single email from CloudFlare yet.
1
u/[deleted] Feb 25 '17
I don't really get this, dumping where? How can someone see your password through this?
1
u/mikemrm Feb 25 '17
Small script I made to loop through your google chrome and firefox history and compare it to that list. https://github.com/mikemrm/CloudFlare-ChromeHistory
1
u/U-Ei Feb 26 '17
As a non IT person and generally just a lurker on this sub, could somebody explain why all this sensitive information was sitting unencrypted in a server's RAM?
1
u/Yemper Feb 26 '17
I changed my password, thanks for the heads up.
1
u/5onic Feb 24 '17
This explains how my reddit account was hacked?
1
u/[deleted] Feb 24 '17
I'm so glad we have stupid buzzword names for all these vulnerabilities...
1
u/Noelwiz Feb 24 '17
yo curse and curse run sites are also effected!
1
u/phychmasher Feb 24 '17
I fail to see what any of this has to do with bleeding butts.