| |
|
Model Comparison
| Model | Editorial | Structural | Class | Conf | SETL | Theme | | @cf/meta/llama-4-scout-17b-16e-instruct lite | 0.00 | +0.04 | Neutral | 0.80 | -0.04 | Elections Data | | @cf/meta/llama-3.3-70b-instruct-fp8-fast lite | 0.00 | +0.10 | Neutral | 0.80 | -0.10 | Election Data | | Section | @cf/meta/llama-4-scout-17b-16e-instruct lite | @cf/meta/llama-3.3-70b-instruct-fp8-fast lite | Delta | | Preamble | ND | ND | | Article 1 | ND | ND | | Article 2 | ND | ND | | Article 3 | ND | ND | | Article 4 | ND | ND | | Article 5 | ND | ND | | Article 6 | ND | ND | | Article 7 | ND | ND | | Article 8 | ND | ND | | Article 9 | ND | ND | | Article 10 | ND | ND | | Article 11 | ND | ND | | Article 12 | ND | ND | | Article 13 | ND | ND | | Article 14 | ND | ND | | Article 15 | ND | ND | | Article 16 | ND | ND | | Article 17 | ND | ND | | Article 18 | ND | ND | | Article 19 | ND | ND | | Article 20 | ND | ND | | Article 21 | ND | ND | | Article 22 | ND | ND | | Article 23 | ND | ND | | Article 24 | ND | ND | | Article 25 | ND | ND | | Article 26 | ND | ND | | Article 27 | ND | ND | | Article 28 | ND | ND | | Article 29 | ND | ND | | Article 30 | ND | ND | | Summary ~lite Elections Data Neutral AP to provide Kalshi with election data
Lite evaluation by llama-4-scout-wai · editorial channel only · no per-section breakdown available
| |
Longitudinal
9 HN snapshots · 2 evals | |
Audit Trail
6 entries | 2026-03-03 06:03 | eval_success | Lite evaluated: Neutral (0.02) | - - | | 2026-03-03 06:03 |
eval
|
Evaluated by llama-4-scout-wai: +0.02 (Neutral) | | | reasoning Press release about data provision, no explicit rights discussion | | 2026-03-03 06:03 | rater_validation_warn | Lite validation warnings for model llama-4-scout-wai: 1W 0R | - - | | 2026-03-03 06:02 | eval_success | Lite evaluated: Neutral (0.05) | - - | | 2026-03-03 06:02 | rater_validation_warn | Lite validation warnings for model llama-3.3-70b-wai: 1W 0R | - - | | 2026-03-03 06:02 |
eval
|
Evaluated by llama-3.3-70b-wai: +0.05 (Neutral) | | | reasoning PR, neutral, open data | | |
| |