| |
|
Model Comparison
| Model | Editorial | Structural | Class | Conf | SETL | Theme | | claude-haiku-4-5 lite | +0.70 | ND | Strong positive | 0.85 | 0.00 | Consumer Rights Protection | | deepseek/deepseek-v3.2-20251201 | +0.28 | +0.30 | Neutral | 0.19 | 0.07 | Government Accountability | | @cf/meta/llama-4-scout-17b-16e-instruct lite | +0.70 | ND | Strong positive | 0.90 | 0.00 | Taxation Rights | | Section | claude-haiku-4-5 lite | deepseek/deepseek-v3.2-20251201 | @cf/meta/llama-4-scout-17b-16e-instruct lite | | Preamble | ND | 0.55 | ND | | Article 1 | ND | ND | ND | | Article 2 | ND | 0.45 | ND | | Article 3 | ND | ND | ND | | Article 4 | ND | ND | ND | | Article 5 | ND | ND | ND | | Article 6 | ND | ND | ND | | Article 7 | ND | 0.20 | ND | | Article 8 | ND | 0.20 | ND | | Article 9 | ND | ND | ND | | Article 10 | ND | ND | ND | | Article 11 | ND | ND | ND | | Article 12 | ND | ND | ND | | Article 13 | ND | ND | ND | | Article 14 | ND | ND | ND | | Article 15 | ND | ND | ND | | Article 16 | ND | ND | ND | | Article 17 | ND | ND | ND | | Article 18 | ND | ND | ND | | Article 19 | ND | 0.72 | ND | | Article 20 | ND | ND | ND | | Article 21 | ND | 0.30 | ND | | Article 22 | ND | ND | ND | | Article 23 | ND | 0.20 | ND | | Article 24 | ND | ND | ND | | Article 25 | ND | 0.50 | ND | | Article 26 | ND | 0.49 | ND | | Article 27 | ND | ND | ND | | Article 28 | ND | 0.30 | ND | | Article 29 | ND | ND | ND | | Article 30 | ND | ND | ND | | Summary ~lite Consumer Rights Protection Champions ProPublica exposes TurboTax deception, credits its reporting with driving IRS reform.
Light evaluation by claude-haiku-4-5 · editorial channel only · no per-section breakdown available
| |
Event Timeline
7 events | 2026-02-27 16:19 | eval_success | Light evaluated: Strong positive (0.70) | - - | | 2026-02-27 13:48 | eval_success | Evaluated: Neutral (0.39) | - - | | 2026-02-27 13:48 | rater_validation_warn | Validation warnings for model deepseek-v3.2: 0W 50R | - - | | 2026-02-27 12:56 | dlq | Dead-lettered after 1 attempts: IRS Reforms Free File Program, Drops Agreement Not to Compete with TurboTax | - - | | 2026-02-27 12:54 | rate_limit | OpenRouter rate limited (429) model=llama-3.3-70b | - - | | 2026-02-27 12:53 | rate_limit | OpenRouter rate limited (429) model=llama-3.3-70b | - - | | 2026-02-27 12:52 | rate_limit | OpenRouter rate limited (429) model=llama-3.3-70b | - - | | |
| |