developer_uid: chai_evaluation_service
submission_id: function_sesot_2025-12-15
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-18T14:51:23+00:00
num_battles: 9461
num_wins: 4717
celo_rating: 1292.38
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-18
win_ratio: 0.4985730895254201
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.8319649696350098s
Received healthy response to inference request in 2.3997435569763184s
Received healthy response to inference request in 2.1207096576690674s
Received healthy response to inference request in 1.683182954788208s
Received healthy response to inference request in 2.0322279930114746s
Received healthy response to inference request in 1.8400719165802002s
Received healthy response to inference request in 2.1661133766174316s
Received healthy response to inference request in 2.0312764644622803s
Received healthy response to inference request in 2.7138619422912598s
Received healthy response to inference request in 2.637247323989868s
10 requests
0 failed requests
5th percentile: 1.7501348614692689
10th percentile: 1.8170867681503295
20th percentile: 1.8384505271911622
30th percentile: 1.9739151000976562
40th percentile: 2.031847381591797
50th percentile: 2.076468825340271
60th percentile: 2.1388711452484133
70th percentile: 2.236202430725098
80th percentile: 2.4472443103790282
90th percentile: 2.6449087858200073
95th percentile: 2.6793853640556335
99th percentile: 2.7069666266441343
mean time: 2.145640015602112
Pipeline stage StressChecker completed in 22.82s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.64s
Shutdown handler de-registered
function_sesot_2025-12-15 status is now deployed due to DeploymentManager action
function_sesot_2025-12-15 status is now inactive due to auto deactivation removed underperforming models
function_sesot_2025-12-15 status is now torndown due to DeploymentManager action