developer_uid: chai_evaluation_service
submission_id: function_sapik_2025-12-15
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-18T22:51:19+00:00
num_battles: 9252
num_wins: 4649
celo_rating: 1295.04
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-18
win_ratio: 0.5024859489840034
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.188145875930786s
Received healthy response to inference request in 2.692680597305298s
Received healthy response to inference request in 2.0752129554748535s
Received healthy response to inference request in 2.542664051055908s
Received healthy response to inference request in 2.2761218547821045s
Received healthy response to inference request in 2.0971081256866455s
Received healthy response to inference request in 2.2227842807769775s
Received healthy response to inference request in 2.272406816482544s
Received healthy response to inference request in 1.7350952625274658s
10 requests
1 failed requests
5th percentile: 1.8881482243537904
10th percentile: 2.041201186180115
20th percentile: 2.092729091644287
30th percentile: 2.160834550857544
40th percentile: 2.208928918838501
50th percentile: 2.2475955486297607
60th percentile: 2.2738928318023683
70th percentile: 2.3560845136642454
80th percentile: 2.572667360305786
90th percentile: 4.434927511215204
95th percentile: 12.275038623809795
99th percentile: 18.5471275138855
mean time: 4.0217369556427
%s, retrying in %s seconds...
Received healthy response to inference request in 3.4923512935638428s
Received healthy response to inference request in 3.051222801208496s
Received healthy response to inference request in 2.703192710876465s
Received healthy response to inference request in 2.4417614936828613s
Received healthy response to inference request in 2.2430715560913086s
Received healthy response to inference request in 2.235832452774048s
Received healthy response to inference request in 2.810560941696167s
Received healthy response to inference request in 2.7186810970306396s
Received healthy response to inference request in 3.284031629562378s
Received healthy response to inference request in 2.9340336322784424s
10 requests
0 failed requests
5th percentile: 2.239090049266815
10th percentile: 2.2423476457595823
20th percentile: 2.402023506164551
30th percentile: 2.624763345718384
40th percentile: 2.71248574256897
50th percentile: 2.7646210193634033
60th percentile: 2.859950017929077
70th percentile: 2.9691903829574584
80th percentile: 3.0977845668792723
90th percentile: 3.3048635959625243
95th percentile: 3.3986074447631833
99th percentile: 3.473602523803711
mean time: 2.791473960876465
Pipeline stage StressChecker completed in 71.25s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.15s
Shutdown handler de-registered
function_sapik_2025-12-15 status is now deployed due to DeploymentManager action
function_sapik_2025-12-15 status is now inactive due to auto deactivation removed underperforming models
function_sapik_2025-12-15 status is now torndown due to DeploymentManager action