🇯🇵 JP Model Bench

Compare aisubscription (GLM pool) vs fugu-ultra (Sakana) on frozen JP fixtures. Runs dispatch the real refresh pipeline via Horizon.

Run comparison

Use aisubscription for GLM pool, fugu-ultra for Sakana.

JP fixtures (10)

jp-1 jp-10 jp-2 jp-3 jp-4 jp-5 jp-6 jp-7 jp-8 jp-9

Recent runs (Mongo)

Name Status Winner Cost
jp1-smoke-6mdl running $0.0000
jpfugu2 completed $0.0000 View
jpval-fugu completed $0.0000 View
jpval-kimi completed kimi-k2.7-code $0.2358 View
jpval-glm completed aisubscription $0.0284 View
jpval-deepseek completed deepseek-v4-pro $0.0901 View
jp-cmp-kimi running $0.0000
jp-cmp-deepseek completed deepseek-v4-pro $1.0028 View
jp-prod-glm completed aisubscription $0.3648 View
jp-full-glm running $0.0000
jp-full-kimi completed $0.0000 View
jp-full-gemini completed $0.0000 View
jp-full-deepseek completed $0.0000 View
jp-smoke3-3 completed aisubscription $0.0470 View
jp-smoke2-3 completed $0.0000 View
jp-smoke-3 completed $0.0000 View
eval-topic-rerun-clean completed aisubscription $0.0020 View

Artifacts on disk

Run ID Updated
6a4cfe6d8b59aaa3b90b3cc3 1 day ago Open
6a4cf59cfcb857af7d0954d3 1 day ago Open
6a4cf59c7bf465d8100be653 1 day ago Open
6a4cf59c098d6139dc052d43 1 day ago Open
6a4cf59cea4db2da8709f733 1 day ago Open
6a4cb1179c7dbf42b8098f13 1 day ago Open
6a4bca6cf34f2fa7dd0b7093 1 day ago Open
6a4bc011ab68e82b2f0f50b3 2 days ago Open
6a4bc011a8fc57796501a203 2 days ago Open
6a4bc011df48d9e6cd08cd33 2 days ago Open
6a4bb11ec0badd9fa70d8a63 2 days ago Open
6a4bad1e61195a195e0a2313 2 days ago Open
6a4ba8cc8cf47d138908e993 2 days ago Open
6a2e929e91913a03350b81a3 3 weeks ago Open
6a2e83c707d6de683d0fbcf3 3 weeks ago Open
6a2e83600a0939b52a0e8013 3 weeks ago Open
6a2df5c0d3c6a7a7e10deae3 3 weeks ago Open
6a2dcc5599c71b417806ff73 3 weeks ago Open
6a2dc5a7a1fcf356a60c3203 3 weeks ago Open
6a2dc213f8406fe2850615b3 3 weeks ago Open