| |
|
Model Comparison
| Model | Editorial | Structural | Class | Conf | SETL | Theme | | claude-haiku-4-5 lite | +0.87 | ND | Strong positive | 0.95 | 0.00 | Mass surveillance privacy rights | | deepseek/deepseek-v3.2-20251201 | +0.21 | ND | Mild positive | 0.24 | — | Privacy & Surveillance | | @cf/meta/llama-4-scout-17b-16e-instruct lite | +1.00 | ND | Strong positive | 1.00 | 0.00 | Whistleblower Rights | | Section | claude-haiku-4-5 lite | deepseek/deepseek-v3.2-20251201 | @cf/meta/llama-4-scout-17b-16e-instruct lite | | Preamble | ND | 0.50 | ND | | Article 1 | ND | 0.88 | ND | | Article 2 | ND | ND | ND | | Article 3 | ND | 0.30 | ND | | Article 4 | ND | ND | ND | | Article 5 | ND | ND | ND | | Article 6 | ND | 0.40 | ND | | Article 7 | ND | ND | ND | | Article 8 | ND | ND | ND | | Article 9 | ND | -0.40 | ND | | Article 10 | ND | ND | ND | | Article 11 | ND | ND | ND | | Article 12 | ND | -0.53 | ND | | Article 13 | ND | ND | ND | | Article 14 | ND | ND | ND | | Article 15 | ND | ND | ND | | Article 16 | ND | ND | ND | | Article 17 | ND | -0.43 | ND | | Article 18 | ND | 0.60 | ND | | Article 19 | ND | 1.00 | ND | | Article 20 | ND | ND | ND | | Article 21 | ND | ND | ND | | Article 22 | ND | ND | ND | | Article 23 | ND | ND | ND | | Article 24 | ND | ND | ND | | Article 25 | ND | ND | ND | | Article 26 | ND | ND | ND | | Article 27 | ND | ND | ND | | Article 28 | ND | 0.50 | ND | | Article 29 | ND | 0.45 | ND | | Article 30 | ND | ND | ND | | Summary ~lite Mass surveillance privacy rights Champions EFF honors NSA whistleblower who exposed mass surveillance rights violations.
Light evaluation by claude-haiku-4-5 · editorial channel only · no per-section breakdown available
| |
Event Timeline
8 events | 2026-02-27 16:32 | eval_success | Light evaluated: Strong positive (1.00) | - - | | 2026-02-27 16:19 | rater_validation_fail | Light parse failure for model llama-4-scout-wai: SyntaxError: Unexpected token '+', ..."itorial": +1.0,
"... is not valid JSON | - - | | 2026-02-27 15:01 | eval_success | Evaluated: Mild positive (0.27) | - - | | 2026-02-27 15:01 | rater_validation_warn | Validation warnings for model deepseek-v3.2: 0W 51R | - - | | 2026-02-27 12:56 | dlq | Dead-lettered after 1 attempts: Mark Klein, AT&T whistleblower who revealed NSA mass spying, has died | - - | | 2026-02-27 12:54 | rate_limit | OpenRouter rate limited (429) model=llama-3.3-70b | - - | | 2026-02-27 12:53 | rate_limit | OpenRouter rate limited (429) model=llama-3.3-70b | - - | | 2026-02-27 12:52 | rate_limit | OpenRouter rate limited (429) model=llama-3.3-70b | - - | | |
| |