H
HN HRCB stories | rights | sources | trends | system | about
home / metr.org / item 44522772
Measuring the impact of AI on experienced open-source developer productivity (metr.org)
775 points by dheerajvs 231 days ago | 485 comments on HN
Pending Evaluation
This story is queued for evaluation. It will be processed in an upcoming batch.
Queued: 2026-02-26 14:03:25
Event Timeline 15 events
2026-02-26 22:08 rater_validation_fail Parse failure for model llama-4-scout-wai: SyntaxError: Expected ':' after property name in JSON at position 3477 (line 131 column 19) - -
2026-02-26 20:01 dlq Dead-lettered after 1 attempts: Measuring the impact of AI on experienced open-source developer productivity - -
2026-02-26 20:01 dlq Dead-lettered after 1 attempts: Measuring the impact of AI on experienced open-source developer productivity - -
2026-02-26 20:01 eval_failure Evaluation failed: Error: Unknown model in registry: llama-4-scout-wai - -
2026-02-26 20:01 eval_failure Evaluation failed: Error: Unknown model in registry: llama-4-scout-wai - -
2026-02-26 19:59 rate_limit OpenRouter rate limited (429) model=llama-3.3-70b - -
2026-02-26 19:59 dlq Dead-lettered after 1 attempts: Measuring the impact of AI on experienced open-source developer productivity - -
2026-02-26 19:59 eval_failure Evaluation failed: Error: Unknown model in registry: llama-4-scout-wai - -
2026-02-26 19:59 eval_failure Evaluation failed: Error: Unknown model in registry: llama-4-scout-wai - -
2026-02-26 19:58 rate_limit OpenRouter rate limited (429) model=llama-3.3-70b - -
2026-02-26 19:57 rate_limit OpenRouter rate limited (429) model=llama-3.3-70b - -
2026-02-26 19:12 dlq Dead-lettered after 1 attempts: Measuring the impact of AI on experienced open-source developer productivity - -
2026-02-26 19:10 rate_limit OpenRouter rate limited (429) model=llama-3.3-70b - -
2026-02-26 19:09 rate_limit OpenRouter rate limited (429) model=llama-3.3-70b - -
2026-02-26 19:08 rate_limit OpenRouter rate limited (429) model=llama-3.3-70b - -
About HRCB | By Right | HN Guidelines | HN FAQ | Source | UDHR | RSS
build 3e57f54+egy5 · deployed 2026-02-26 22:02 UTC · evaluated 2026-02-26 22:10:52 UTC