+0.27 Building a Minimal Transformer for 10-digit Addition (alexlitzenberger.com S:+0.28 )
40 points by kelseyfrog 5 hours ago | 7 comments on HN | Moderate positive Contested Editorial · v3.7 · 2026-03-01 00:53:49 0
Summary Free Expression & Education Access Acknowledges
This technical blog post provides freely accessible educational content on machine learning with minimal human rights dimensions. The content supports freedom of expression (Article 19) and education access (Article 26) through open publication and no-barrier distribution. However, structural implementation includes Google Analytics tracking without visible consent or privacy disclosure, creating mild tension with privacy rights (Article 12). Overall, the page leans slightly positive through knowledge democratization but lacks human rights awareness in privacy handling.
Article Heatmap
Preamble: ND — Preamble Preamble: No Data — Preamble P Article 1: ND — Freedom, Equality, Brotherhood Article 1: No Data — Freedom, Equality, Brotherhood 1 Article 2: ND — Non-Discrimination Article 2: No Data — Non-Discrimination 2 Article 3: ND — Life, Liberty, Security Article 3: No Data — Life, Liberty, Security 3 Article 4: ND — No Slavery Article 4: No Data — No Slavery 4 Article 5: ND — No Torture Article 5: No Data — No Torture 5 Article 6: ND — Legal Personhood Article 6: No Data — Legal Personhood 6 Article 7: ND — Equality Before Law Article 7: No Data — Equality Before Law 7 Article 8: ND — Right to Remedy Article 8: No Data — Right to Remedy 8 Article 9: ND — No Arbitrary Detention Article 9: No Data — No Arbitrary Detention 9 Article 10: ND — Fair Hearing Article 10: No Data — Fair Hearing 10 Article 11: ND — Presumption of Innocence Article 11: No Data — Presumption of Innocence 11 Article 12: ND — Privacy Article 12: No Data — Privacy 12 Article 13: ND — Freedom of Movement Article 13: No Data — Freedom of Movement 13 Article 14: ND — Asylum Article 14: No Data — Asylum 14 Article 15: ND — Nationality Article 15: No Data — Nationality 15 Article 16: ND — Marriage & Family Article 16: No Data — Marriage & Family 16 Article 17: ND — Property Article 17: No Data — Property 17 Article 18: ND — Freedom of Thought Article 18: No Data — Freedom of Thought 18 Article 19: +0.42 — Freedom of Expression 19 Article 20: ND — Assembly & Association Article 20: No Data — Assembly & Association 20 Article 21: ND — Political Participation Article 21: No Data — Political Participation 21 Article 22: ND — Social Security Article 22: No Data — Social Security 22 Article 23: ND — Work & Equal Pay Article 23: No Data — Work & Equal Pay 23 Article 24: ND — Rest & Leisure Article 24: No Data — Rest & Leisure 24 Article 25: ND — Standard of Living Article 25: No Data — Standard of Living 25 Article 26: +0.37 — Education 26 Article 27: +0.23 — Cultural Participation 27 Article 28: ND — Social & International Order Article 28: No Data — Social & International Order 28 Article 29: ND — Duties to Community Article 29: No Data — Duties to Community 29 Article 30: ND — No Destruction of Rights Article 30: No Data — No Destruction of Rights 30
Negative Neutral Positive No Data
Aggregates
Editorial Mean +0.27 Structural Mean +0.28
Weighted Mean +0.34 Unweighted Mean +0.34
Max +0.42 Article 19 Min +0.23 Article 27
Signal 3 No Data 28
Volatility 0.08 (Low)
Negative 0 Channels E: 0.6 S: 0.4
SETL -0.05 Structural-dominant
FW Ratio 59% 27 facts · 19 inferences
Evidence 9% coverage
4M 6L 28 ND
Theme Radar
Foundation Security Legal Privacy & Movement Personal Expression Economic & Social Cultural Order & Duties Foundation: 0.00 (0 articles) Security: 0.00 (0 articles) Legal: 0.00 (0 articles) Privacy & Movement: 0.00 (0 articles) Personal: 0.00 (0 articles) Expression: 0.42 (1 articles) Economic & Social: 0.00 (0 articles) Cultural: 0.30 (2 articles) Order & Duties: 0.00 (0 articles)
HN Discussion 3 top-level · 3 replies
pankajdoharey 2026-02-28 22:45 UTC link
Looks like a Tiny Analytic transformer, RNN is arguably a better choice if you are gonna handwire an architecture to mechanically do addition. Learning is about discovering the patterns and algorithm from data. Wiring a machine to follow a procedure defeats that purpose.
wizzwizz4 2026-02-28 23:14 UTC link
I somewhat feel that using floating point arithmetic for what should be a symbol manipulation exercise is cheating. The deserialisation technique is interesting enough that I'm not really upset, though.

> The codex solution reversed the order which makes sense for making carry logic easy, but it is less clean.

That's the approach I'd have gone with. I've long been an advocate of little-endian numerical representations. That said, if there's a maximum number of digits, it's straightforward to implement the circuitry needed to do calculate the most-significant digit of the result in one go; and I somehow doubt the AI-generated solution really took advantage of the tricks that little-endian allows.

> At some point I set claude code on some debugging to my surprise I don’t recall it actually solving any of the bugs, it seemed much more concerned with “correcting” the funky things I was intentionally doing.

It baffles me that somebody capable of this kind of work would find this surprising. The process that allows LLMs to find bugs in code is the same process that entreats them to "correct" such creativity: their understanding of the world begins and ends at statistical plausibility, and they cannot truly comprehend things (though they can do a very good job of pretending, given sufficient training data).

lacunary 2026-02-28 23:33 UTC link
What's the difference between comprehending and understanding in this context?
dnautics 2026-03-01 01:56 UTC link
symbol manipulation in transformers is fp arithmetic?
dnautics 2026-03-01 01:57 UTC link
it proves that the algorithm is embeddable in a bigger transformer of ~similar architecture.
Editorial Channel
What the content says
+0.30
Article 19 Freedom of Expression
Medium Advocacy Practice
Editorial
+0.30
SETL
-0.13

Article 19 addresses freedom of opinion and expression. Blog platform enables author to publish technical content freely. Page uses markdown rendering and maintains author attribution, supporting expression of ideas.

+0.25
Article 26 Education
Medium Advocacy Practice
Editorial
+0.25
SETL
-0.12

Article 26 addresses education and development. Technical blog post provides educational content on machine learning and transformers, contributing to technical education and human development.

+0.25
Article 27 Cultural Participation
Medium Advocacy Practice
Editorial
+0.25
SETL
+0.11

Article 27 addresses participation in cultural life and intellectual property. Blog shares author's intellectual work and technical knowledge, contributing to cultural and scientific commons.

ND
Preamble Preamble
Low Practice

Preamble addresses human dignity and rights. Page content is technical in nature with no direct engagement with Preamble themes.

ND
Article 1 Freedom, Equality, Brotherhood
Low Practice

Article 1 addresses equal dignity and reason. Technical content does not directly engage with equality or dignity themes.

ND
Article 2 Non-Discrimination
Low Practice

Article 2 addresses non-discrimination. Technical tutorial content is neutral on discrimination issues.

ND
Article 3 Life, Liberty, Security

No observable engagement with right to life, liberty, security of person.

ND
Article 4 No Slavery

No observable engagement with slavery or servitude.

ND
Article 5 No Torture

No observable engagement with torture or cruel treatment.

ND
Article 6 Legal Personhood

No observable engagement with right to recognition before law.

ND
Article 7 Equality Before Law

No observable engagement with equal protection before law.

ND
Article 8 Right to Remedy

No observable engagement with right to effective remedy.

ND
Article 9 No Arbitrary Detention

No observable engagement with freedom from arbitrary arrest.

ND
Article 10 Fair Hearing

No observable engagement with right to fair hearing.

ND
Article 11 Presumption of Innocence

No observable engagement with criminal accountability or ex post facto principles.

ND
Article 12 Privacy
Medium Practice

Article 12 addresses privacy and protection from interference. Technical content does not directly address privacy.

ND
Article 13 Freedom of Movement
Low Practice

Article 13 addresses freedom of movement. Content does not address this right.

ND
Article 14 Asylum

No observable engagement with right to asylum.

ND
Article 15 Nationality

No observable engagement with right to nationality.

ND
Article 16 Marriage & Family

No observable engagement with marriage and family rights.

ND
Article 17 Property

No observable engagement with property rights.

ND
Article 18 Freedom of Thought

No observable engagement with freedom of conscience and religion.

ND
Article 20 Assembly & Association
Low Practice

Article 20 addresses freedom of assembly and association. Content does not address these themes.

ND
Article 21 Political Participation

No observable engagement with political participation.

ND
Article 22 Social Security

No observable engagement with social security or welfare rights.

ND
Article 23 Work & Equal Pay

No observable engagement with labor rights or fair wages.

ND
Article 24 Rest & Leisure

No observable engagement with rest and leisure.

ND
Article 25 Standard of Living

No observable engagement with adequate standard of living or health.

ND
Article 28 Social & International Order
Low Practice

Article 28 addresses right to order where rights are protected. Content does not directly address this.

ND
Article 29 Duties to Community

No observable engagement with duties and limitations of rights.

ND
Article 30 No Destruction of Rights

No observable engagement with prohibition of abuse of rights.

Structural Channel
What the site does
Element Modifier Affects Note
Legal & Terms
Privacy -0.15
Article 12
Google Analytics tracking (G-7GW8V704L5) with scroll depth and outbound link monitoring. Disabled on localhost only. No explicit privacy policy or consent mechanism visible in page content.
Terms of Service
No terms of service visible on page.
Identity & Mission
Mission
Personal blog; no organizational mission statement present.
Editorial Code
No editorial code or standards visible.
Ownership
Personal domain; author clearly identified as Alex Litzenberger.
Access & Distribution
Access Model +0.10
Article 19 Article 26
Open access blog content. No paywall or registration barrier observed. Free distribution of technical knowledge.
Ad/Tracking -0.10
Article 12
Google Analytics event tracking for user behavior (scroll depth, outbound clicks) without explicit user consent mechanism visible.
Accessibility
Page uses semantic HTML and schema.org markup. LaTeX rendering and markdown support present. No explicit accessibility statement observed.
+0.35
Article 19 Freedom of Expression
Medium Advocacy Practice
Structural
+0.35
Context Modifier
+0.10
SETL
-0.13

Platform structure supports free publication and dissemination of ideas. Open access and public availability enable wide distribution. Schema.org markup and metadata management support content discovery and proper attribution.

+0.30
Article 26 Education
Medium Advocacy Practice
Structural
+0.30
Context Modifier
+0.10
SETL
-0.12

Open access blog structure removes barriers to technical education. Free distribution of learning content supports universal access to knowledge. Public nature enables global reach.

+0.20
Article 27 Cultural Participation
Medium Advocacy Practice
Structural
+0.20
Context Modifier
0.00
SETL
+0.11

Public blog participation shares intellectual property with community. Author attribution (Schema.org) respects intellectual property rights. No apparent restrictions on knowledge sharing.

ND
Preamble Preamble
Low Practice

Open access structure and free distribution of knowledge align with commitment to universal rights principles. Google Analytics tracking without explicit consent creates minor tension with dignity principles.

ND
Article 1 Freedom, Equality, Brotherhood
Low Practice

Open access structure provides equal opportunity for all individuals to access knowledge regardless of socioeconomic status, supporting dignity and reason principles.

ND
Article 2 Non-Discrimination
Low Practice

Open access without registration or identity requirements inherently removes barriers to participation based on status, race, national origin, or other protected characteristics.

ND
Article 3 Life, Liberty, Security

No structural implications.

ND
Article 4 No Slavery

No structural implications.

ND
Article 5 No Torture

No structural implications.

ND
Article 6 Legal Personhood

No structural implications.

ND
Article 7 Equality Before Law

No structural implications.

ND
Article 8 Right to Remedy

No structural implications.

ND
Article 9 No Arbitrary Detention

No structural implications.

ND
Article 10 Fair Hearing

No structural implications.

ND
Article 11 Presumption of Innocence

No structural implications.

ND
Article 12 Privacy
Medium Practice

Site implements Google Analytics tracking of user behavior (scroll depth, outbound link clicks) without visible consent mechanism or privacy disclosure. Tracking is granular and persistent across page views.

ND
Article 13 Freedom of Movement
Low Practice

Open internet access enables global movement of information and freedom of access to knowledge without geographic restrictions.

ND
Article 14 Asylum

No structural implications.

ND
Article 15 Nationality

No structural implications.

ND
Article 16 Marriage & Family

No structural implications.

ND
Article 17 Property

No structural implications.

ND
Article 18 Freedom of Thought

No structural implications.

ND
Article 20 Assembly & Association
Low Practice

Blog provides platform for individual expression and potentially enables community around technical ideas, supporting association.

ND
Article 21 Political Participation

No structural implications.

ND
Article 22 Social Security

No structural implications.

ND
Article 23 Work & Equal Pay

No structural implications.

ND
Article 24 Rest & Leisure

No structural implications.

ND
Article 25 Standard of Living

No structural implications.

ND
Article 28 Social & International Order
Low Practice

Open, transparent platform design with clear information architecture and schema markup supports ordered information access.

ND
Article 29 Duties to Community

No observable engagement with duties and limitations of rights.

ND
Article 30 No Destruction of Rights

No structural implications.

Supplementary Signals
How this content communicates, beyond directional lean. Learn more
Epistemic Quality
How well-sourced and evidence-based is this content?
0.48 medium claims
Sources
0.4
Evidence
0.5
Uncertainty
0.3
Purpose
0.7
Propaganda Flags
No manipulative rhetoric detected
0 techniques detected
Emotional Tone
Emotional character: positive/negative, intensity, authority
measured
Valence
+0.2
Arousal
0.3
Dominance
0.4
Transparency
Does the content identify its author and disclose interests?
0.50
✓ Author
More signals: context, framing & audience
Solution Orientation
Does this content offer solutions or only describe problems?
0.56 mixed
Reader Agency
0.6
Stakeholder Voice
Whose perspectives are represented in this content?
0.20 1 perspective
Speaks: institution
Temporal Framing
Is this content looking backward, at the present, or forward?
present unspecified
Geographic Scope
What geographic area does this content cover?
global
Complexity
How accessible is this content to a general audience?
technical high jargon domain specific
Longitudinal 112 HN snapshots · 10 evals
+1 0 −1 HN
Audit Trail 25 entries
2026-03-01 01:31 model_divergence Cross-model spread 0.34 exceeds threshold (3 models) - -
2026-03-01 01:31 eval_success Lite evaluated: Neutral (0.00) - -
2026-03-01 01:31 eval Evaluated by llama-3.3-70b-wai: 0.00 (Neutral) 0.00
reasoning
tech blog post
2026-03-01 01:30 eval_success Lite evaluated: Neutral (0.00) - -
2026-03-01 01:30 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Tech tutorial blog post, no human rights discussion
2026-03-01 01:30 model_divergence Cross-model spread 0.34 exceeds threshold (3 models) - -
2026-03-01 01:26 eval_success Lite evaluated: Neutral (0.00) - -
2026-03-01 01:26 model_divergence Cross-model spread 0.34 exceeds threshold (3 models) - -
2026-03-01 01:26 eval Evaluated by llama-3.3-70b-wai: 0.00 (Neutral) 0.00
reasoning
tech blog post
2026-03-01 00:53 eval_success Evaluated: Moderate positive (0.34) - -
2026-03-01 00:53 model_divergence Cross-model spread 0.34 exceeds threshold (2 models) - -
2026-03-01 00:53 eval Evaluated by claude-haiku-4-5-20251001: +0.34 (Moderate positive) 12,274 tokens
2026-03-01 00:53 rater_validation_warn Validation warnings for model claude-haiku-4-5-20251001: 21W 28R - -
2026-03-01 00:46 eval_success Lite evaluated: Neutral (0.00) - -
2026-03-01 00:46 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Tech tutorial blog post, no human rights discussion
2026-03-01 00:43 eval_success Lite evaluated: Neutral (0.00) - -
2026-03-01 00:43 eval Evaluated by llama-3.3-70b-wai: 0.00 (Neutral) 0.00
reasoning
tech blog post
2026-03-01 00:05 eval_success Lite evaluated: Neutral (0.00) - -
2026-03-01 00:05 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Tech tutorial blog post, no human rights discussion
2026-03-01 00:03 eval_success Lite evaluated: Neutral (0.00) - -
2026-03-01 00:03 eval Evaluated by llama-3.3-70b-wai: 0.00 (Neutral) 0.00
reasoning
tech blog post
2026-02-28 23:11 eval_success Lite evaluated: Neutral (0.00) - -
2026-02-28 23:11 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral)
reasoning
Tech tutorial blog post, no human rights discussion
2026-02-28 23:10 eval_success Lite evaluated: Neutral (0.00) - -
2026-02-28 23:10 eval Evaluated by llama-3.3-70b-wai: 0.00 (Neutral)
reasoning
tech blog post