jp-cmp-deepseek · status: completed

Bench results

capability fixture model status score cost($) dur(s)
refresh jp-1 deepseek-v4-pro success 6.38 0.056159 387.6
refresh jp-10 deepseek-v4-pro warning - 0.101455 2,994.2
refresh jp-2 deepseek-v4-pro success 6.5 0.063697 303.3
refresh jp-3 deepseek-v4-pro error - 0.000000 2,401.8
refresh jp-4 deepseek-v4-pro success 7.63 0.140233 979.6
refresh jp-5 deepseek-v4-pro warning - 0.203111 3,263.3
refresh jp-6 deepseek-v4-pro success 6.38 0.236809 1,142.7
refresh jp-7 deepseek-v4-pro warning - 0.111248 2,750.5
refresh jp-8 deepseek-v4-pro success 6.63 0.090052 619.1
refresh jp-9 deepseek-v4-pro error - 0.000000 2,152.2

Winners

  • score: deepseek-v4-pro
  • cost: deepseek-v4-pro
  • speed: deepseek-v4-pro
  • overall: deepseek-v4-pro