developer_uid: chai_evaluation_service
submission_id: function_sumut_2025-12-16
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-19T00:51:16+00:00
num_battles: 7349
num_wins: 3649
celo_rating: 1290.69
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-18
win_ratio: 0.49653014015512315
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.755521774291992s
Received healthy response to inference request in 2.324981927871704s
Received healthy response to inference request in 5.061536073684692s
Received healthy response to inference request in 2.7244534492492676s
Received healthy response to inference request in 3.933729887008667s
Received healthy response to inference request in 1.8875832557678223s
Received healthy response to inference request in 3.4051928520202637s
Received healthy response to inference request in 1.7893571853637695s
Received healthy response to inference request in 2.630676746368408s
Received healthy response to inference request in 2.8117403984069824s
10 requests
0 failed requests
5th percentile: 1.8335589170455933
10th percentile: 1.877760648727417
20th percentile: 2.237502193450928
30th percentile: 2.538968300819397
40th percentile: 2.686942768096924
50th percentile: 2.768096923828125
60th percentile: 3.0491213798522945
70th percentile: 3.510291528701782
80th percentile: 3.7911633968353273
90th percentile: 4.046510505676269
95th percentile: 4.5540232896804795
99th percentile: 4.9600335168838505
mean time: 3.032477355003357
Pipeline stage StressChecker completed in 32.05s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.61s
Shutdown handler de-registered
function_sumut_2025-12-16 status is now deployed due to DeploymentManager action
function_sumut_2025-12-16 status is now inactive due to auto deactivation removed underperforming models
function_sumut_2025-12-16 status is now torndown due to DeploymentManager action