Model Comparison
Model Editorial Structural Class Conf SETL Theme
@cf/meta/llama-4-scout-17b-16e-instruct lite ND ND 0.80
@cf/meta/llama-3.3-70b-instruct-fp8-fast lite ND ND 0.40
@cf/meta/llama-4-scout-17b-16e-instruct lite 0.00 ND Neutral 0.90 0.00 Technology
@cf/meta/llama-3.3-70b-instruct-fp8-fast lite 0.00 ND Neutral 0.90 0.00 No human rights
Section @cf/meta/llama-4-scout-17b-16e-instruct lite @cf/meta/llama-3.3-70b-instruct-fp8-fast lite @cf/meta/llama-4-scout-17b-16e-instruct lite @cf/meta/llama-3.3-70b-instruct-fp8-fast lite
Preamble ND ND ND ND
Article 1 ND ND ND ND
Article 2 ND ND ND ND
Article 3 ND ND ND ND
Article 4 ND ND ND ND
Article 5 ND ND ND ND
Article 6 ND ND ND ND
Article 7 ND ND ND ND
Article 8 ND ND ND ND
Article 9 ND ND ND ND
Article 10 ND ND ND ND
Article 11 ND ND ND ND
Article 12 ND ND ND ND
Article 13 ND ND ND ND
Article 14 ND ND ND ND
Article 15 ND ND ND ND
Article 16 ND ND ND ND
Article 17 ND ND ND ND
Article 18 ND ND ND ND
Article 19 ND ND ND ND
Article 20 ND ND ND ND
Article 21 ND ND ND ND
Article 22 ND ND ND ND
Article 23 ND ND ND ND
Article 24 ND ND ND ND
Article 25 ND ND ND ND
Article 26 ND ND ND ND
Article 27 ND ND ND ND
Article 28 ND ND ND ND
Article 29 ND ND ND ND
Article 30 ND ND ND ND
ND AGENTS.md outperforms skills in our agent evals (vercel.com)
524 points by maximedupre 35 days ago | 199 comments on HN ~lite vlite-2.0
Summary ~lite
Technical blog post discussing agent evals with no apparent threats or manipulative language.
Lite evaluation by llama-4-scout-wai-psq · editorial channel only · no per-section breakdown available
Longitudinal · 4 evals
+1 0 −1 HN
Audit Trail 8 entries
2026-03-05 10:25 eval_success PSQ evaluated: g-PSQ=-0.040 (3 dims) - -
2026-03-05 10:25 eval Evaluated by llama-4-scout-wai-psq: -0.04 (Neutral)
2026-03-05 10:19 eval_success PSQ evaluated: g-PSQ=0.000 (3 dims) - -
2026-03-05 10:19 eval Evaluated by llama-3.3-70b-wai-psq: 0.00 (Neutral)
2026-03-01 00:48 eval_success Lite evaluated: Neutral (0.00) - -
2026-03-01 00:48 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral)
reasoning
ED neutral tech blog post
2026-03-01 00:47 eval_success Lite evaluated: Neutral (0.00) - -
2026-03-01 00:47 eval Evaluated by llama-3.3-70b-wai: 0.00 (Neutral)
reasoning
Tech blog no rights stance