ND Randomization in Controlled Experiments (queue.acm.org)
21 points by pykq 8 days ago | 2 comments on HN ~lite vlite-2.0
Summary ~lite
The article discusses the importance of proper randomization in controlled experiments.
Lite evaluation by llama-4-scout-wai-psq · editorial channel only · no per-section breakdown available
Longitudinal 432 HN snapshots · 85 evals
+1 0 −1 HN
Audit Trail 105 entries
2026-03-22 00:40 eval_success PSQ evaluated: g-PSQ=0.280 (3 dims) - -
2026-03-22 00:40 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-22 00:39 eval_success Lite evaluated: Neutral (0.00) - -
2026-03-22 00:39 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-22 00:39 rater_validation_warn Lite validation warnings for model llama-4-scout-wai: 1W 0R - -
2026-03-21 23:03 eval_success PSQ evaluated: g-PSQ=0.280 (3 dims) - -
2026-03-21 23:03 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 22:57 eval_success Lite evaluated: Neutral (0.00) - -
2026-03-21 22:57 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 22:57 rater_validation_warn Lite validation warnings for model llama-4-scout-wai: 1W 0R - -
2026-03-21 21:42 eval_success PSQ evaluated: g-PSQ=0.280 (3 dims) - -
2026-03-21 21:42 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 21:40 eval_success Lite evaluated: Neutral (0.00) - -
2026-03-21 21:40 rater_validation_warn Lite validation warnings for model llama-4-scout-wai: 1W 0R - -
2026-03-21 21:40 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 21:05 eval_success PSQ evaluated: g-PSQ=0.280 (3 dims) - -
2026-03-21 21:05 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 20:59 eval_success Lite evaluated: Neutral (0.00) - -
2026-03-21 20:59 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 20:59 rater_validation_warn Lite validation warnings for model llama-4-scout-wai: 1W 0R - -
2026-03-21 19:48 eval_success PSQ evaluated: g-PSQ=0.280 (3 dims) - -
2026-03-21 19:48 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 19:44 eval_success Lite evaluated: Neutral (0.00) - -
2026-03-21 19:44 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 19:44 rater_validation_warn Lite validation warnings for model llama-4-scout-wai: 1W 0R - -
2026-03-21 19:09 eval_success PSQ evaluated: g-PSQ=0.280 (3 dims) - -
2026-03-21 19:09 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 19:07 eval_success Lite evaluated: Neutral (0.00) - -
2026-03-21 19:07 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 19:07 rater_validation_warn Lite validation warnings for model llama-4-scout-wai: 1W 0R - -
2026-03-21 18:27 eval_success PSQ evaluated: g-PSQ=0.280 (3 dims) - -
2026-03-21 18:27 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 18:27 eval_success Lite evaluated: Neutral (0.00) - -
2026-03-21 18:27 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 17:47 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 17:47 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 17:07 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 17:07 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 16:27 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 16:26 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 15:47 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 15:45 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 15:08 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 15:05 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 14:29 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 14:23 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 13:47 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 13:41 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 13:09 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 13:00 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 12:28 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 12:19 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 11:52 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 11:43 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 11:12 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 11:04 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 10:32 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 10:22 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 09:49 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 09:41 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 09:09 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 09:02 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 08:32 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 08:24 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 07:53 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 07:42 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 07:12 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 07:02 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 06:34 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 06:24 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 05:57 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 05:43 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 05:21 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 05:03 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 04:42 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 04:26 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 04:04 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 03:47 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 03:24 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 03:09 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 02:49 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 02:28 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 02:12 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 01:50 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 01:34 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 00:49 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-21 00:45 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-21 00:15 eval Evaluated by llama-3.3-70b-wai-psq: +0.20 (Mild positive)
2026-03-21 00:12 eval Evaluated by llama-3.3-70b-wai: -0.08 (Neutral)
reasoning
Technical content, zero rights discussion
2026-03-20 23:50 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-20 23:43 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-20 23:09 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-20 23:02 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-20 21:56 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-20 21:49 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-20 21:19 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-20 21:13 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-20 20:43 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-20 20:35 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-20 20:05 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-20 20:01 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-20 19:28 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive) 0.00
2026-03-20 19:26 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral) 0.00
reasoning
Technical article on randomization in controlled experiments, no human rights discussion
2026-03-20 18:17 eval Evaluated by llama-4-scout-wai-psq: +0.28 (Mild positive)
2026-03-20 18:16 eval Evaluated by llama-4-scout-wai: 0.00 (Neutral)
reasoning
Technical article on randomization in controlled experiments, no human rights discussion