developer_uid: chai_evaluation_service
submission_id: function_sotot_2025-12-16
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-19T15:21:18+00:00
num_battles: 11797
num_wins: 5808
celo_rating: 1287.79
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-19
win_ratio: 0.49232855810799353
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.930943489074707s
Received healthy response to inference request in 2.362248420715332s
Received healthy response to inference request in 2.966224431991577s
Received healthy response to inference request in 3.3516111373901367s
Received healthy response to inference request in 2.4169790744781494s
Received healthy response to inference request in 2.2752556800842285s
Received healthy response to inference request in 2.2745425701141357s
Received healthy response to inference request in 3.2062315940856934s
Received healthy response to inference request in 2.12912917137146s
Received healthy response to inference request in 2.702732801437378s
10 requests
0 failed requests
5th percentile: 2.194565200805664
10th percentile: 2.260001230239868
20th percentile: 2.27511305809021
30th percentile: 2.336150598526001
40th percentile: 2.3950868129730223
50th percentile: 2.5598559379577637
60th percentile: 2.7940170764923096
70th percentile: 2.941527771949768
80th percentile: 3.0142258644104003
90th percentile: 3.2207695484161376
95th percentile: 3.286190342903137
99th percentile: 3.338526978492737
mean time: 2.66158983707428
Pipeline stage StressChecker completed in 28.79s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.59s
Shutdown handler de-registered
function_sotot_2025-12-16 status is now deployed due to DeploymentManager action
function_sotot_2025-12-16 status is now inactive due to auto deactivation removed underperforming models
function_sotot_2025-12-16 status is now torndown due to DeploymentManager action