| |
|
Model Comparison
| Model | Editorial | Structural | Class | Conf | SETL | Theme | | claude-haiku-4-5 lite | +0.72 | ND | Strong positive | 0.80 | 0.00 | Investigative accountability journalism | | deepseek/deepseek-v3.2-20251201 | +0.80 | +0.24 | Strong positive | 0.09 | 0.65 | Free Expression | | Section | claude-haiku-4-5 lite | deepseek/deepseek-v3.2-20251201 | Delta | | Preamble | ND | 0.90 | | Article 1 | ND | ND | | Article 2 | ND | 0.25 | | Article 3 | ND | ND | | Article 4 | ND | ND | | Article 5 | ND | ND | | Article 6 | ND | ND | | Article 7 | ND | ND | | Article 8 | ND | ND | | Article 9 | ND | ND | | Article 10 | ND | ND | | Article 11 | ND | ND | | Article 12 | ND | ND | | Article 13 | ND | ND | | Article 14 | ND | ND | | Article 15 | ND | ND | | Article 16 | ND | ND | | Article 17 | ND | ND | | Article 18 | ND | ND | | Article 19 | ND | 1.00 | | Article 20 | ND | 0.95 | | Article 21 | ND | ND | | Article 22 | ND | ND | | Article 23 | ND | ND | | Article 24 | ND | ND | | Article 25 | ND | 0.40 | | Article 26 | ND | 0.45 | | Article 27 | ND | ND | | Article 28 | ND | ND | | Article 29 | ND | ND | | Article 30 | ND | ND | | Summary ~lite Investigative accountability journalism Advocates Independent nonprofit newsroom dedicated to public interest investigative journalism.
Light evaluation by claude-haiku-4-5 · editorial channel only · no per-section breakdown available
| |
Event Timeline
8 events | 2026-02-27 16:47 | rater_validation_fail | Light parse failure for model llama-4-scout-wai: SyntaxError: Unexpected token '+', ..."itorial": +0.8,
"... is not valid JSON | - - | | 2026-02-27 16:32 | rater_validation_fail | Light parse failure for model llama-4-scout-wai: SyntaxError: Unexpected token '+', ..."itorial": +0.8,
"... is not valid JSON | - - | | 2026-02-27 16:17 | rater_validation_fail | Light parse failure for model llama-4-scout-wai: SyntaxError: Unexpected token '+', ..."itorial": +0.8,
"... is not valid JSON | - - | | 2026-02-27 15:17 | eval_success | Evaluated: Strong positive (0.76) | - - | | 2026-02-27 13:06 | dlq | Dead-lettered after 1 attempts: [CAL-LIGHT] ProPublica (EP-4) | - - | | 2026-02-27 13:04 | rate_limit | OpenRouter rate limited (429) model=llama-3.3-70b | - - | | 2026-02-27 13:03 | rate_limit | OpenRouter rate limited (429) model=llama-3.3-70b | - - | | 2026-02-27 13:02 | rate_limit | OpenRouter rate limited (429) model=llama-3.3-70b | - - | | |
| |