| |
Alpha This system is experimental. Scores and classifications are early-stage research and may be unreliable. Methodology → |
|
Model Comparison
| Model | Editorial | Structural | Class | Conf | SETL | Theme | | @cf/meta/llama-3.3-70b-instruct-fp8-fast lite | +0.20 | -0.60 | Moderate negative | 0.80 | 0.69 | Consumer Protection | | @cf/meta/llama-3.3-70b-instruct-fp8-fast lite | ND | ND | — | 0.77 | — | — | | @cf/meta/llama-4-scout-17b-16e-instruct lite | ND | ND | — | — | — | — | | openai/gpt-oss-120b:free lite | ND | ND | — | — | — | — | | google/gemma-3-27b-it:free lite | ND | ND | — | — | — | — | | qwen/qwen3-coder:free lite | ND | ND | — | — | — | — | | @cf/meta/llama-4-scout-17b-16e-instruct lite | ND | ND | — | — | — | — | | Section | @cf/meta/llama-3.3-70b-instruct-fp8-fast lite | @cf/meta/llama-3.3-70b-instruct-fp8-fast lite | @cf/meta/llama-4-scout-17b-16e-instruct lite | openai/gpt-oss-120b:free lite | google/gemma-3-27b-it:free lite | qwen/qwen3-coder:free lite | @cf/meta/llama-4-scout-17b-16e-instruct lite | | Preamble | ND | ND | ND | ND | ND | ND | ND | | Article 1 | ND | ND | ND | ND | ND | ND | ND | | Article 2 | ND | ND | ND | ND | ND | ND | ND | | Article 3 | ND | ND | ND | ND | ND | ND | ND | | Article 4 | ND | ND | ND | ND | ND | ND | ND | | Article 5 | ND | ND | ND | ND | ND | ND | ND | | Article 6 | ND | ND | ND | ND | ND | ND | ND | | Article 7 | ND | ND | ND | ND | ND | ND | ND | | Article 8 | ND | ND | ND | ND | ND | ND | ND | | Article 9 | ND | ND | ND | ND | ND | ND | ND | | Article 10 | ND | ND | ND | ND | ND | ND | ND | | Article 11 | ND | ND | ND | ND | ND | ND | ND | | Article 12 | ND | ND | ND | ND | ND | ND | ND | | Article 13 | ND | ND | ND | ND | ND | ND | ND | | Article 14 | ND | ND | ND | ND | ND | ND | ND | | Article 15 | ND | ND | ND | ND | ND | ND | ND | | Article 16 | ND | ND | ND | ND | ND | ND | ND | | Article 17 | ND | ND | ND | ND | ND | ND | ND | | Article 18 | ND | ND | ND | ND | ND | ND | ND | | Article 19 | ND | ND | ND | ND | ND | ND | ND | | Article 20 | ND | ND | ND | ND | ND | ND | ND | | Article 21 | ND | ND | ND | ND | ND | ND | ND | | Article 22 | ND | ND | ND | ND | ND | ND | ND | | Article 23 | ND | ND | ND | ND | ND | ND | ND | | Article 24 | ND | ND | ND | ND | ND | ND | ND | | Article 25 | ND | ND | ND | ND | ND | ND | ND | | Article 26 | ND | ND | ND | ND | ND | ND | ND | | Article 27 | ND | ND | ND | ND | ND | ND | ND | | Article 28 | ND | ND | ND | ND | ND | ND | ND | | Article 29 | ND | ND | ND | ND | ND | ND | ND | | Article 30 | ND | ND | ND | ND | ND | ND | ND | | Summary ~lite Consumer Protection Acknowledges FTC rule on unfair fees
Lite evaluation by llama-3.3-70b-wai · editorial channel only · no per-section breakdown available
| |
Longitudinal
· 2 evals | |
Audit Trail
6 entries | 2026-03-07 21:03 | rater_validation_fail | Lite parse failure for model llama-4-scout-wai: SyntaxError: Unexpected non-whitespace character after JSON at position 852 (line 27 column 1) | - - | | 2026-03-07 20:55 | eval_success | Lite evaluated: Moderate negative (-0.36) | - - | | 2026-03-07 20:55 |
eval
|
Evaluated by llama-3.3-70b-wai: -0.36 (Moderate negative) | | | reasoning FTC press release on unfair fees | | 2026-03-06 03:31 | rater_validation_fail | Lite parse failure for model llama-4-scout-wai-psq: SyntaxError: Unexpected non-whitespace character after JSON at position 961 (line 28 column 1) | - - | | 2026-03-06 03:27 | eval_success | PSQ evaluated: g-PSQ=-0.279 (3 dims) | - - | | 2026-03-06 03:27 |
eval
|
Evaluated by llama-3.3-70b-wai-psq: -0.28 (Mild negative) | | | |
| |