function_pabim_2025-12-16

developer_uid: chai_evaluation_service

submission_id: function_pabim_2025-12-16

model_name: richard

model_group:

status: torndown

timestamp: 2025-12-19T15:51:19+00:00

num_battles: 10885

num_wins: 5611

celo_rating: 1304.11

family_friendly_score: 0.0

family_friendly_standard_error: 0.0

submission_type: function

display_name: richard

is_internal_developer: True

ranking_group: single

us_pacific_date: 2025-12-19

win_ratio: 0.515480018373909

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.721547842025757s
Received healthy response to inference request in 1.9625437259674072s
Received healthy response to inference request in 3.3800461292266846s
Received healthy response to inference request in 1.9779517650604248s
Received healthy response to inference request in 2.798203706741333s
Received healthy response to inference request in 2.157886028289795s
Received healthy response to inference request in 2.8305397033691406s
Received healthy response to inference request in 2.4825663566589355s
Received healthy response to inference request in 2.44800066947937s
10 requests
1 failed requests
5th percentile: 1.9694773435592652
10th percentile: 1.9764109611511231
20th percentile: 2.1218991756439207
30th percentile: 2.3609662771224973
40th percentile: 2.4687400817871095
50th percentile: 2.602057099342346
60th percentile: 2.752210187911987
70th percentile: 2.807904505729675
80th percentile: 2.9404409885406495
90th percentile: 5.053155469894403
95th percentile: 12.582147502899153
99th percentile: 18.605341129302982
mean time: 4.287042546272278
%s, retrying in %s seconds...
Received healthy response to inference request in 2.5101730823516846s
Received healthy response to inference request in 2.339691162109375s
Received healthy response to inference request in 2.058013916015625s
Received healthy response to inference request in 1.8418872356414795s
Received healthy response to inference request in 2.6759657859802246s
Received healthy response to inference request in 2.9285030364990234s
Received healthy response to inference request in 2.098940134048462s
Received healthy response to inference request in 2.001967430114746s
Received healthy response to inference request in 1.7727382183074951s
Received healthy response to inference request in 2.6912174224853516s
10 requests
0 failed requests
5th percentile: 1.8038552761077882
10th percentile: 1.834972333908081
20th percentile: 1.9699513912200928
30th percentile: 2.041199970245361
40th percentile: 2.082569646835327
50th percentile: 2.2193156480789185
60th percentile: 2.4078839302062987
70th percentile: 2.5599108934402466
80th percentile: 2.67901611328125
90th percentile: 2.7149459838867185
95th percentile: 2.8217245101928707
99th percentile: 2.907147331237793
mean time: 2.2919097423553465
Pipeline stage StressChecker completed in 75.58s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.56s
Shutdown handler de-registered
function_pabim_2025-12-16 status is now deployed due to DeploymentManager action
function_pabim_2025-12-16 status is now inactive due to auto deactivation removed underperforming models
function_pabim_2025-12-16 status is now torndown due to DeploymentManager action