function_robel_2025-12-16

developer_uid: chai_evaluation_service

submission_id: function_robel_2025-12-16

model_name: richard

model_group:

status: torndown

timestamp: 2025-12-19T05:51:18+00:00

num_battles: 8680

num_wins: 4446

celo_rating: 1301.79

family_friendly_score: 0.0

family_friendly_standard_error: 0.0

submission_type: function

display_name: richard

is_internal_developer: True

ranking_group: single

us_pacific_date: 2025-12-18

win_ratio: 0.5122119815668202

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 3.3939452171325684s
Received healthy response to inference request in 2.79803729057312s
Received healthy response to inference request in 2.238034248352051s
Received healthy response to inference request in 2.5174858570098877s
Received healthy response to inference request in 2.070827007293701s
Received healthy response to inference request in 3.036797523498535s
Received healthy response to inference request in 1.9591374397277832s
Received healthy response to inference request in 2.630044937133789s
Received healthy response to inference request in 2.4361982345581055s
10 requests
1 failed requests
5th percentile: 2.0093977451324463
10th percentile: 2.0596580505371094
20th percentile: 2.204592800140381
30th percentile: 2.376749038696289
40th percentile: 2.484970808029175
50th percentile: 2.5737653970718384
60th percentile: 2.6972418785095216
70th percentile: 2.8696653604507447
80th percentile: 3.108227062225342
90th percentile: 5.077232480049127
95th percentile: 12.652025163173658
99th percentile: 18.71185930967331
mean time: 4.3307325601577755
%s, retrying in %s seconds...
Received healthy response to inference request in 2.256810426712036s
Received healthy response to inference request in 2.241356134414673s
Received healthy response to inference request in 3.0170717239379883s
Received healthy response to inference request in 1.9649832248687744s
Received healthy response to inference request in 2.864642858505249s
Received healthy response to inference request in 3.1541244983673096s
Received healthy response to inference request in 2.8172624111175537s
Received healthy response to inference request in 2.005856990814209s
Received healthy response to inference request in 3.1065244674682617s
Received healthy response to inference request in 2.4724690914154053s
10 requests
0 failed requests
5th percentile: 1.98337641954422
10th percentile: 2.0017696142196657
20th percentile: 2.19425630569458
30th percentile: 2.252174139022827
40th percentile: 2.386205625534058
50th percentile: 2.6448657512664795
60th percentile: 2.8362145900726317
70th percentile: 2.910371518135071
80th percentile: 3.034962272644043
90th percentile: 3.1112844705581666
95th percentile: 3.132704484462738
99th percentile: 3.1498404955863952
mean time: 2.590110182762146
Pipeline stage StressChecker completed in 79.28s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.39s
Shutdown handler de-registered
function_robel_2025-12-16 status is now deployed due to DeploymentManager action
function_robel_2025-12-16 status is now inactive due to auto deactivation removed underperforming models
function_robel_2025-12-16 status is now torndown due to DeploymentManager action