developer_uid: chai_evaluation_service
submission_id: function_jipar_2025-12-16
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-19T19:51:21+00:00
num_battles: 10502
num_wins: 5228
celo_rating: 1291.66
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-19
win_ratio: 0.49780994096362596
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.2169933319091797s
Received healthy response to inference request in 4.085930824279785s
Received healthy response to inference request in 2.4721834659576416s
Received healthy response to inference request in 2.5408265590667725s
Received healthy response to inference request in 3.3143765926361084s
Received healthy response to inference request in 3.2792441844940186s
Received healthy response to inference request in 2.283704996109009s
Received healthy response to inference request in 2.4856820106506348s
Received healthy response to inference request in 2.8405728340148926s
10 requests
1 failed requests
5th percentile: 2.247013580799103
10th percentile: 2.277033829689026
20th percentile: 2.434487771987915
30th percentile: 2.481632447242737
40th percentile: 2.5187687397003176
50th percentile: 2.6906996965408325
60th percentile: 3.0160413742065426
70th percentile: 3.2897839069366457
80th percentile: 3.468687438964844
90th percentile: 5.6926799774169865
95th percentile: 12.923051166534407
99th percentile: 18.70734811782837
mean time: 4.56729371547699
%s, retrying in %s seconds...
Received healthy response to inference request in 2.597531795501709s
Received healthy response to inference request in 3.2953085899353027s
Received healthy response to inference request in 2.6850595474243164s
Received healthy response to inference request in 3.429706335067749s
Received healthy response to inference request in 2.4953882694244385s
Received healthy response to inference request in 1.9516332149505615s
Received healthy response to inference request in 3.6079261302948s
Received healthy response to inference request in 2.725595235824585s
Received healthy response to inference request in 1.9083268642425537s
Received healthy response to inference request in 2.2700743675231934s
10 requests
0 failed requests
5th percentile: 1.9278147220611572
10th percentile: 1.9473025798797607
20th percentile: 2.206386137008667
30th percentile: 2.427794098854065
40th percentile: 2.5566743850708007
50th percentile: 2.6412956714630127
60th percentile: 2.7012738227844237
70th percentile: 2.8965092420578
80th percentile: 3.322188138961792
90th percentile: 3.447528314590454
95th percentile: 3.5277272224426266
99th percentile: 3.591886348724365
mean time: 2.696655035018921
Pipeline stage StressChecker completed in 75.69s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.06s
Shutdown handler de-registered
function_jipar_2025-12-16 status is now deployed due to DeploymentManager action
function_jipar_2025-12-16 status is now inactive due to auto deactivation removed underperforming models
function_jipar_2025-12-16 status is now torndown due to DeploymentManager action