developer_uid: chai_evaluation_service
submission_id: function_jabil_2025-12-15
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-18T02:11:19+00:00
num_battles: 9492
num_wins: 4720
celo_rating: 1291.38
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-17
win_ratio: 0.4972608512431521
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.9444332122802734s
Received healthy response to inference request in 3.7779812812805176s
Received healthy response to inference request in 3.291332721710205s
Received healthy response to inference request in 2.713655710220337s
Received healthy response to inference request in 2.499512195587158s
Received healthy response to inference request in 2.0369625091552734s
Received healthy response to inference request in 2.0082650184631348s
Received healthy response to inference request in 2.3812620639801025s
Received healthy response to inference request in 2.27610182762146s
Received healthy response to inference request in 2.383054733276367s
10 requests
0 failed requests
5th percentile: 2.021178889274597
10th percentile: 2.0340927600860597
20th percentile: 2.2282739639282227
30th percentile: 2.34971399307251
40th percentile: 2.3823376655578614
50th percentile: 2.4412834644317627
60th percentile: 2.5851696014404295
70th percentile: 2.782888960838318
80th percentile: 3.01381311416626
90th percentile: 3.339997577667236
95th percentile: 3.5589894294738764
99th percentile: 3.7341829109191895
mean time: 2.631256127357483
Pipeline stage StressChecker completed in 27.55s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.55s
Shutdown handler de-registered
function_jabil_2025-12-15 status is now deployed due to DeploymentManager action
function_jabil_2025-12-15 status is now inactive due to auto deactivation removed underperforming models
function_jabil_2025-12-15 status is now torndown due to DeploymentManager action