function_dasor_2025-12-16

developer_uid: chai_evaluation_service

submission_id: function_dasor_2025-12-16

model_name: richard

model_group:

status: torndown

timestamp: 2025-12-19T05:21:14+00:00

num_battles: 9608

num_wins: 4815

celo_rating: 1293.85

family_friendly_score: 0.0

family_friendly_standard_error: 0.0

submission_type: function

display_name: richard

is_internal_developer: True

ranking_group: single

us_pacific_date: 2025-12-18

win_ratio: 0.5011448792672772

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.3477203845977783s
Received healthy response to inference request in 2.0941905975341797s
Received healthy response to inference request in 2.524280071258545s
Received healthy response to inference request in 2.486607313156128s
Received healthy response to inference request in 3.7093312740325928s
Received healthy response to inference request in 2.3948042392730713s
Received healthy response to inference request in 2.8333728313446045s
Received healthy response to inference request in 1.7782654762268066s
Received healthy response to inference request in 2.226003885269165s
10 requests
1 failed requests
5th percentile: 1.9204317808151246
10th percentile: 2.0625980854034425
20th percentile: 2.199641227722168
30th percentile: 2.311205434799194
40th percentile: 2.375970697402954
50th percentile: 2.4407057762145996
60th percentile: 2.501676416397095
70th percentile: 2.6170078992843626
80th percentile: 3.0085645198822024
90th percentile: 5.348959279060358
95th percentile: 12.727285301685317
99th percentile: 18.629946119785313
mean time: 4.250018739700318
%s, retrying in %s seconds...
Received healthy response to inference request in 3.4111311435699463s
Received healthy response to inference request in 2.1155011653900146s
Received healthy response to inference request in 2.0524089336395264s
Received healthy response to inference request in 2.5725526809692383s
Received healthy response to inference request in 2.715709924697876s
Received healthy response to inference request in 2.3315696716308594s
Received healthy response to inference request in 2.117496967315674s
Received healthy response to inference request in 2.671525239944458s
Received healthy response to inference request in 2.9652228355407715s
Received healthy response to inference request in 3.4310810565948486s
10 requests
0 failed requests
5th percentile: 2.080800437927246
10th percentile: 2.1091919422149656
20th percentile: 2.117097806930542
30th percentile: 2.2673478603363035
40th percentile: 2.4761594772338866
50th percentile: 2.622038960456848
60th percentile: 2.689199113845825
70th percentile: 2.7905637979507447
80th percentile: 3.0544044971466064
90th percentile: 3.4131261348724364
95th percentile: 3.4221035957336428
99th percentile: 3.4292855644226075
mean time: 2.6384199619293214
Pipeline stage StressChecker completed in 71.79s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.57s
Shutdown handler de-registered
function_dasor_2025-12-16 status is now deployed due to DeploymentManager action
function_dasor_2025-12-16 status is now inactive due to auto deactivation removed underperforming models
function_dasor_2025-12-16 status is now torndown due to DeploymentManager action