H
HN HRCB top | articles | domains | dashboard | models | factions | about | exp
home / item 25415989
+0.16 Google outage – resolved
2316 points by abluecloud 1899 days ago | 827 comments on HN | Mild positive Editorial · v3.7 ·
Summary Digital Infrastructure & Access Acknowledges
This HN self-post reports a Google service outage (YouTube, Gmail, Docs, Drive) and its resolution. While the content is purely factual and makes no explicit human rights claims, HN's structural platform strongly supports freedoms of expression and participation by enabling free information sharing, community discourse, and technical knowledge production without paywalls or discriminatory barriers. The post demonstrates how community platforms facilitate collective awareness and response to infrastructure events affecting broad populations.
Article Heatmap
Preamble: ND — Preamble Preamble: No Data — Preamble P Article 1: +0.10 — Freedom, Equality, Brotherhood 1 Article 2: +0.10 — Non-Discrimination 2 Article 3: ND — Life, Liberty, Security Article 3: No Data — Life, Liberty, Security 3 Article 4: ND — No Slavery Article 4: No Data — No Slavery 4 Article 5: ND — No Torture Article 5: No Data — No Torture 5 Article 6: ND — Legal Personhood Article 6: No Data — Legal Personhood 6 Article 7: ND — Equality Before Law Article 7: No Data — Equality Before Law 7 Article 8: ND — Right to Remedy Article 8: No Data — Right to Remedy 8 Article 9: ND — No Arbitrary Detention Article 9: No Data — No Arbitrary Detention 9 Article 10: ND — Fair Hearing Article 10: No Data — Fair Hearing 10 Article 11: ND — Presumption of Innocence Article 11: No Data — Presumption of Innocence 11 Article 12: +0.10 — Privacy 12 Article 13: ND — Freedom of Movement Article 13: No Data — Freedom of Movement 13 Article 14: ND — Asylum Article 14: No Data — Asylum 14 Article 15: ND — Nationality Article 15: No Data — Nationality 15 Article 16: ND — Marriage & Family Article 16: No Data — Marriage & Family 16 Article 17: ND — Property Article 17: No Data — Property 17 Article 18: ND — Freedom of Thought Article 18: No Data — Freedom of Thought 18 Article 19: +0.16 — Freedom of Expression 19 Article 20: +0.20 — Assembly & Association 20 Article 21: ND — Political Participation Article 21: No Data — Political Participation 21 Article 22: ND — Social Security Article 22: No Data — Social Security 22 Article 23: ND — Work & Equal Pay Article 23: No Data — Work & Equal Pay 23 Article 24: ND — Rest & Leisure Article 24: No Data — Rest & Leisure 24 Article 25: ND — Standard of Living Article 25: No Data — Standard of Living 25 Article 26: ND — Education Article 26: No Data — Education 26 Article 27: +0.30 — Cultural Participation 27 Article 28: ND — Social & International Order Article 28: No Data — Social & International Order 28 Article 29: ND — Duties to Community Article 29: No Data — Duties to Community 29 Article 30: ND — No Destruction of Rights Article 30: No Data — No Destruction of Rights 30
Negative Neutral Positive No Data
Aggregates
Weighted Mean +0.16 Unweighted Mean +0.16
Max +0.30 Article 27 Min +0.10 Article 1
Signal 6 No Data 25
Confidence 13% Volatility 0.07 (Low)
Negative 0 Channels E: 0.6 S: 0.4
SETL -0.40 Structural-dominant
FW Ratio 53% 9 facts · 8 inferences
Evidence: High: 1 Medium: 5 Low: 0 No Data: 25
Theme Radar
Foundation Security Legal Privacy & Movement Personal Expression Economic & Social Cultural Order & Duties Foundation: 0.10 (2 articles) Security: 0.00 (0 articles) Legal: 0.00 (0 articles) Privacy & Movement: 0.10 (1 articles) Personal: 0.00 (0 articles) Expression: 0.18 (2 articles) Economic & Social: 0.00 (0 articles) Cultural: 0.30 (1 articles) Order & Duties: 0.00 (0 articles)
HN Discussion 20 top-level · 30 replies
Avalaxy 2020-12-14 11:54 UTC link
The status page has proven itself useless again. According to that page, everything is working perfectly fine.
tosh 2020-12-14 11:54 UTC link
Just checked https://www.google.com/appsstatus

all green, which does not reflect reality for me (e.g. Gmail is down)

edit: shows how incredibly difficult introspection is

have_faith 2020-12-14 11:56 UTC link
Gmail said my account was "temporarily" unavailable... had a moment considering if it wasn't temporary. Good reminder to remove my reliance on gmail especially.
Waterluvian 2020-12-14 11:58 UTC link
1. Phone Gmail won't load. 2. Turn off wifi and use cell network. Still won't load. 3. Check hacker news.
mmillin 2020-12-14 12:00 UTC link
Given the blast radius of this (all regions appear to be impacted) along with the fact that services that don't rely on auth are working as normal, it must be a global authN/Z issue. I do not envy Google engineers right now.
javindo 2020-12-14 12:01 UTC link
The fact it seems to be related to login reminds me of the Tom Scott doomsday fictional lecture which I would link to but you know...
Mistri 2020-12-14 12:04 UTC link
It's super interesting that all Google services that I've tried are down _except_ for Google Search. What would isolate Search from the rest of Google's products such that it wouldn't be affected by a mass outage like this?
jacquesm 2020-12-14 12:05 UTC link
So, anybody still feel like arguing that 'the cloud' is a viable back-up? Or is that a sore point right now? Just for a moment imagine: what if it never comes back again?

Of course it will, - at least, it better - but what if it doesn't? And if it does, are you going to take countermeasures in case it happens again or is it just going to be 'back to normal' again?

h43k3r 2020-12-14 12:11 UTC link
Everything is affected. Its Gaia(Google Auth) outage, most probably.

Disclaimer - Googler here whose workplace chat is not working.

js4ever 2020-12-14 12:11 UTC link
This topic is so hot it's crashing HN! Super long server response time and I get this error quite oftenly: "We're having some trouble serving your request. Sorry!"
DebtDeflation 2020-12-14 12:24 UTC link
Just got a text from my kids' school saying GMail is down and to use the school's direct email. Immediate reaction was "Google isn't down you idiots, the problem is on your end", go to check GMail, yep it's down.
vineyardmike 2020-12-14 12:25 UTC link
Help! My Waymo taxi won't open the doors without me logging into the app. Its driving around in circles on route 500 and won't stop.

/s - for now ;)

justkez 2020-12-14 12:30 UTC link
Unless I'm misunderstanding something, they are going to have an immense SLA claim issue. 99.9% SLA on Workspace services, so any business paying for Google for Business (now known as Workspace) is going to have a credit claim (assuming the outage is longer than 43m 49s which feels like it will be).

Edit: As I comment it looks like things are coming back! Timing or what...

madmax108 2020-12-14 12:32 UTC link
Atlassian's #HugOps page[1] collates messages of support for Devops as a public embedded Google Map and it really encapsulates the current feeling!

https://imgur.com/a/3RurTYf

Don't forget to #HugOps all the people who've been woken up on a monday morning with this! Hope this gets resolved soon :)

[1] https://www.atlassian.com/software/statuspage/hugops

pg_bot 2020-12-14 12:32 UTC link
Gmail and Youtube are back online for me. Hangouts is beach balling. There is a warning at the top of my screen though.

"Gmail is temporarily unable to access your Contacts. You may experience issues while this persists."

hackernews1134 2020-12-14 12:46 UTC link
4:41AM PT, Google services have been restored to my accounts (free & gsuite).

And I have never seen them load so fast before - gmail progress bar barely seen for a fraction of a second whereas I am more used to seeing it for multiple seconds (2-3 sec) until it loads.

I observe the same anecdotal speedup for other sites... drive, youtube, calendar. I wonder if they are throwing all the hardware they have at their services or I am encountering underutilized servers since it is not fixed for everyone.

It is nice to experience (even if it is short lived) the snappiness of Google services if they weren't so multi-tenented.

pdkl95 2020-12-14 12:52 UTC link
As many comments in this thread have mentioned, the crash seems to happen when when logged in; youtube and other services seem to work when don't send the session cookie. This suggests something very fundamental related to user account/sessions is failing...

Did Maria Christensen make a mistake when adding "return true;"?

(This is a joke referencing Tom Scott's 2014 parable[1] about the danger of designing a system with a single point of failure. Tom's tells the fictional tale of a high level employee at Google adding "return true;" to the global "handleLogin()" function.)

[1] https://www.youtube.com/watch?v=y4GB_NDU43Q (you might need to open this link in a private window...)

kabes 2020-12-14 13:09 UTC link
When I tried to login it said: 'this account does not exist'. So my first thought was some algorithm made a mistake and my account got deleted for no reason.

I already imagined the only solution now was to write a medium post and hope it gets some traction on hackernews and google support steps in. Thinking to myself I was an idiot for knowing all this and still thinking it wouldn't happen to me.

And even though it turns out to be an outage, it gave me a bad enough feeling to start using a domain name I own for my email.

eric_khun 2020-12-14 13:36 UTC link
If you pay for Google Services, they have an SLA (service level agreement) of 99.9% [1]. If their services are down more than 43 minutes this month[2], you can request “free days” of usage.

Edit: Services were down from ~12:55pm to ~1:52pm, it's 57minutes. Thanks hiby007

[1] https://workspace.google.com/intl/en/terms/sla.html

[2] https://en.wikipedia.org/wiki/High_availability#Percentage_c...

nojvek 2020-12-14 16:13 UTC link
Don’t blame people, blame systems and processes. I assume Google has a blameless process too. If an engineer can bring down huge swaths of google that’s not a human problem. As an eng your you should heavily invest in a sane test -> deploy -> monitoring process, and reward reliability.

Give people a bonus when things didn’t break, not only when there is a superhero that fixes broken things. Then you’re rewarding fragile systems that need superheroes.

faeyanpiraat 2020-12-14 11:56 UTC link
HN is my goto status page when these things happen, never failed to provide up-to-date reliable information.
espadrine 2020-12-14 11:57 UTC link
It is all green if you do not need to be logged in.

If you are logged in, the page crashes with an error.

You can still browse all services from Incognito (which for some is not an option).

fny 2020-12-14 11:57 UTC link
https://downdetector.com/ is remarkably good at catching this too.

But funnily enough, a lot of the votes come from traffic that searches for "is ____ down?" on Google. XD

kiechu 2020-12-14 11:58 UTC link
What if it is a static website of corporate propaganda?
tomglynch 2020-12-14 12:01 UTC link
Same for me - and then I tried logging in to gmail in an incognito window and got "Couldn't find your Google account" which really scared me.
pupdogg 2020-12-14 12:01 UTC link
What's the point of having a status page when it can't reliably tell you the factual status?
tux3 2020-12-14 12:04 UTC link
Thunderbird prompting me to login, and getting "Google does not recognize this email address" as a reply was a nice adrenaline spike, until I checked the status on HN!
partyguy 2020-12-14 12:06 UTC link
Oh yeah that talk was crazy!!
dreamer7 2020-12-14 12:07 UTC link
It is something related to authentication. Even YouTube works without being logged in
fishbacon 2020-12-14 12:10 UTC link
It looks like it is related to authentication, landing pages seem to be working, so going incognito you can still use youtube.

I would guess the search page does not actually use your credentials for anything since fingerprinting is separate from login?

graposaymaname 2020-12-14 12:12 UTC link
nicebill8 2020-12-14 12:15 UTC link
I’d guess Search is pretty well segregated from basically everything else because of how valuable it is - I’m logged into Google on Search and it works fine (unlike everything else)
mrcus 2020-12-14 12:16 UTC link
Nope, especially considering the implications of this, with the amount of people working remotely. Google Meet, Classroom, etc. are down. This is probably literally costing billions every minute just in loss of productivity.
cvrjk 2020-12-14 12:17 UTC link
For a second I legit thought Google banned my account for some reason. And I don't like it that I feel relieved..
xendergrunge 2020-12-14 12:19 UTC link
Nice. very subtle reference to our dependability on google products. you can still link the YT lecture from a private session.
daliusd 2020-12-14 12:19 UTC link
It works fine. You can't login only.
gfitz 2020-12-14 12:20 UTC link
The nature of this downtime is quite severe. How are Googlers resolving this if their internal communications are down?
TomGullen 2020-12-14 12:22 UTC link
The way I see it, backups are a strategy to reduce risk of ruin.

For me, backing up to the Cloud is fine, because I find the risk of my home being broken into and everything stolen AND the cloud goes down AND the cloud services are completely unrecoverable is a small enough risk to tolerate.

I don't think it's possible to have permanently indestructible files in existence over a given time period.

gberger 2020-12-14 12:23 UTC link
This is bad opsec
LandR 2020-12-14 12:28 UTC link
I can't login to anything via Google Auth this morning.

It reports error that my Google Account can't be found. I thought my account had been deleted!

bonoboTP 2020-12-14 12:31 UTC link
I guess a lot of people are fine with the risk.

Everybody uses it, so if, like, Gmail loses all the emails, we are then in such a state that the consequences will be more bearable and socially normal.

Most people are fine with accepting that whatever future thing will happen to most people will also happen to them. Because then the consequences will also be normal.

If the apocalypse comes, it comes for almost all of us and that's consolation enough.

buremba 2020-12-14 12:34 UTC link
Google Search Images doesn't work either: https://www.google.com/search?q=random&tbm=isch&source=lnms
smarx007 2020-12-14 12:35 UTC link
Of course it's viable as a backup. Availability != realibility. My data is still reliably saved in the cloud even if there is an outage for a few hours. The key point is backup, e.g. Dropbox. When you use Google Docs, it becomes a single source of truth and a SPOF.
fouronnes3 2020-12-14 12:35 UTC link
yeah this is like saying it must be a compiler bug
emilburzo 2020-12-14 12:38 UTC link
I started this[1] the last time something similarly scary happened.

It's very comforting to have a local copy of everything important in situations like this one.

[1] https://wiki.emilburzo.com/backing-up-your-google-digital-li...

elymar 2020-12-14 12:40 UTC link
Yeah I couldn’t get the hours of operation for a store near me on Google maps. Thought it was wifi at first.
tarruda 2020-12-14 12:45 UTC link
> I do not envy Google engineers right now.

A few years ago I released a bug in production that prevented users from logging into our desktop app. It affected about ~1k users before we found out and rolled back the release.

I still remember a very cold feeling in my belly, barely could sleep that night. It is difficult to imagine what the people responsible for this are feeling right now.

forgotmypw17 2020-12-14 12:46 UTC link
Most of the things I backed up for myself are either gone forever or irretrievably lost.

Most of the things I backed up with google remain largely accessible, except for an occasion like this.

It's rare that any services I operate solo come back this quickly after there is a downing issue.

mbar84 2020-12-14 12:47 UTC link
Different failure mode. If the cloud goes down, many more people are affected. If your self-hosted thing goes down, only you are affected. If everybody self-hosted, would the overall downtime be lower? Even if it were, would it be worth the effort of self-hosting?
rubatuga 2020-12-14 12:49 UTC link
Oh man, you're right. Bloated gmail loaded instantly. What's going on? It's loading almost 2x to 3x faster.
Editorial Channel
What the content says
0.00
Article 19 Freedom of Expression
High F-Coverage S-Practice
Editorial
0.00
SETL
-0.40

The self-post reports factual information about service outages but does not discuss freedom of expression as a right.

ND
Preamble Preamble

The preamble affirms human dignity and rights; the self-post does not engage with these principles.

ND
Article 1 Freedom, Equality, Brotherhood
Medium S-Practice

The self-post does not discuss human equality or dignity.

ND
Article 2 Non-Discrimination
Medium S-Practice

The self-post does not address non-discrimination.

ND
Article 3 Life, Liberty, Security

No engagement with security or liberty.

ND
Article 4 No Slavery

No engagement with slavery.

ND
Article 5 No Torture

No engagement with torture.

ND
Article 6 Legal Personhood

No engagement with legal recognition.

ND
Article 7 Equality Before Law

No engagement with equal protection.

ND
Article 8 Right to Remedy

No engagement with remedy for violations.

ND
Article 9 No Arbitrary Detention

No engagement with arbitrary arrest.

ND
Article 10 Fair Hearing

No engagement with fair hearing.

ND
Article 11 Presumption of Innocence

No engagement with fair trial.

ND
Article 12 Privacy
Medium S-Practice

The self-post does not discuss privacy rights.

ND
Article 13 Freedom of Movement

No engagement with freedom of movement.

ND
Article 14 Asylum

No engagement with asylum.

ND
Article 15 Nationality

No engagement with nationality.

ND
Article 16 Marriage & Family

No engagement with family rights.

ND
Article 17 Property

No engagement with property rights.

ND
Article 18 Freedom of Thought

No engagement with freedom of thought.

ND
Article 20 Assembly & Association
Medium S-Practice

No engagement with peaceful assembly.

ND
Article 21 Political Participation

No engagement with political participation.

ND
Article 22 Social Security

No engagement with social security.

ND
Article 23 Work & Equal Pay

No engagement with work or labor.

ND
Article 24 Rest & Leisure

No engagement with rest and leisure.

ND
Article 25 Standard of Living

No engagement with health or social care despite reporting on services affected.

ND
Article 26 Education

No engagement with education rights despite reporting on services used for learning.

ND
Article 27 Cultural Participation
Medium S-Practice C-Coverage

The self-post participates in technical community discourse but does not discuss rights to scientific participation.

ND
Article 28 Social & International Order

No engagement with social order.

ND
Article 29 Duties to Community

No engagement with duties to community.

ND
Article 30 No Destruction of Rights

No engagement with prohibition of rights restrictions.

Structural Channel
What the site does
+0.40
Article 19 Freedom of Expression
High F-Coverage S-Practice
Structural
+0.40
Context Modifier
ND
SETL
-0.40

HN actively enables freedom of expression by allowing free posting and discussion of factual information without censorship or discriminatory barriers.

+0.30
Article 27 Cultural Participation
Medium S-Practice C-Coverage
Structural
+0.30
Context Modifier
ND
SETL
ND

HN is fundamentally designed for scientific and technical discourse; the post contributes to community participation in digital infrastructure discussion regardless of economic status.

+0.20
Article 20 Assembly & Association
Medium S-Practice
Structural
+0.20
Context Modifier
ND
SETL
ND

HN functions as a community where users voluntarily associate around shared interests in technology and discussion.

+0.10
Article 1 Freedom, Equality, Brotherhood
Medium S-Practice
Structural
+0.10
Context Modifier
ND
SETL
ND

HN allows all users to participate equally in posting and discussion, supporting Article 1's principles.

+0.10
Article 2 Non-Discrimination
Medium S-Practice
Structural
+0.10
Context Modifier
ND
SETL
ND

HN's community guidelines explicitly oppose discrimination, supporting Article 2.

+0.10
Article 12 Privacy
Medium S-Practice
Structural
+0.10
Context Modifier
ND
SETL
ND

HN's minimal data collection and tracking practices respect privacy expectations.

ND
Preamble Preamble

HN's platform structure supports dissemination of information consistent with the Preamble's goals, though not explicitly addressed.

ND
Article 3 Life, Liberty, Security

No observable structural signals regarding security or liberty.

ND
Article 4 No Slavery

No observable structural signals.

ND
Article 5 No Torture

No observable structural signals.

ND
Article 6 Legal Personhood

No observable structural signals.

ND
Article 7 Equality Before Law

No observable structural signals.

ND
Article 8 Right to Remedy

No observable structural signals.

ND
Article 9 No Arbitrary Detention

No observable structural signals.

ND
Article 10 Fair Hearing

No observable structural signals.

ND
Article 11 Presumption of Innocence

No observable structural signals.

ND
Article 13 Freedom of Movement

No observable structural signals.

ND
Article 14 Asylum

No observable structural signals.

ND
Article 15 Nationality

No observable structural signals.

ND
Article 16 Marriage & Family

No observable structural signals.

ND
Article 17 Property

No observable structural signals.

ND
Article 18 Freedom of Thought

No observable structural signals.

ND
Article 21 Political Participation

While HN enables community decision-making through voting, it is not a governmental system and does not directly address Article 21.

ND
Article 22 Social Security

No observable structural signals.

ND
Article 23 Work & Equal Pay

No observable structural signals.

ND
Article 24 Rest & Leisure

No observable structural signals.

ND
Article 25 Standard of Living

No observable structural signals regarding health or social care.

ND
Article 26 Education

No observable structural signals regarding education.

ND
Article 28 Social & International Order

No observable structural signals.

ND
Article 29 Duties to Community

No observable structural signals.

ND
Article 30 No Destruction of Rights

No observable structural signals.

Supplementary Signals
Epistemic Quality
0.65
Propaganda Flags
0 techniques detected
Solution Orientation
No data
Emotional Tone
No data
Stakeholder Voice
No data
Temporal Framing
No data
Geographic Scope
No data
Complexity
No data
Transparency
No data
Event Timeline 20 events
2026-02-26 08:55 dlq Dead-lettered after 1 attempts: Google outage – resolved - -
2026-02-26 08:55 dlq Dead-lettered after 1 attempts: Google outage – resolved - -
2026-02-26 08:55 dlq Dead-lettered after 1 attempts: Google outage – resolved - -
2026-02-26 08:54 dlq Dead-lettered after 1 attempts: Google outage – resolved - -
2026-02-26 08:53 rate_limit OpenRouter rate limited (429) model=llama-3.3-70b - -
2026-02-26 08:53 rate_limit OpenRouter rate limited (429) model=hermes-3-405b - -
2026-02-26 08:53 rate_limit OpenRouter rate limited (429) model=mistral-small-3.1 - -
2026-02-26 08:53 rate_limit OpenRouter rate limited (429) model=qwen3-next-80b - -
2026-02-26 08:52 rate_limit OpenRouter rate limited (429) model=mistral-small-3.1 - -
2026-02-26 08:52 rate_limit OpenRouter rate limited (429) model=llama-3.3-70b - -
2026-02-26 08:52 rate_limit OpenRouter rate limited (429) model=hermes-3-405b - -
2026-02-26 08:52 rate_limit OpenRouter rate limited (429) model=qwen3-next-80b - -
2026-02-26 08:51 rate_limit OpenRouter rate limited (429) model=mistral-small-3.1 - -
2026-02-26 08:51 rate_limit OpenRouter rate limited (429) model=hermes-3-405b - -
2026-02-26 08:51 rate_limit OpenRouter rate limited (429) model=llama-3.3-70b - -
2026-02-26 08:51 rate_limit OpenRouter rate limited (429) model=qwen3-next-80b - -
2026-02-26 08:34 rater_validation_fail Parse failure for model nemotron-nano-30b: Error: No content in OpenRouter response - -
2026-02-26 08:31 dlq Dead-lettered after 1 attempts: Google outage – resolved - -
2026-02-26 08:31 eval_retry OpenRouter API error 400 model=step-3.5-flash - -
2026-02-26 08:31 eval_failure Evaluation failed: Error: OpenRouter API error 400: {"error":{"message":"Provider returned error","code":400,"metadata":{"raw":"{\"error\":{\"message\":\"response_format json_object is not supported for this model\",\"t - -
About HRCB | By Right | HN Guidelines | HN FAQ | Source | UDHR | RSS
build 1686d6e+53hr · deployed 2026-02-26 10:15 UTC · evaluated 2026-02-26 06:43:03 UTC