developer_uid: chai_evaluation_service
submission_id: function_fehos_2025-12-16
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-19T03:01:14+00:00
num_battles: 7422
num_wins: 3662
celo_rating: 1288.47
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-18
win_ratio: 0.4933980059283212
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 3.668306827545166s
Received healthy response to inference request in 1.9633088111877441s
Received healthy response to inference request in 3.144247531890869s
Received healthy response to inference request in 2.236362934112549s
Received healthy response to inference request in 2.539635419845581s
Received healthy response to inference request in 2.8043341636657715s
Received healthy response to inference request in 2.319441556930542s
Received healthy response to inference request in 2.8705830574035645s
Received healthy response to inference request in 2.6265037059783936s
10 requests
1 failed requests
5th percentile: 2.0861831665039063
10th percentile: 2.2090575218200685
20th percentile: 2.3028258323669433
30th percentile: 2.4735772609710693
40th percentile: 2.5917563915252684
50th percentile: 2.7154189348220825
60th percentile: 2.8308337211608885
70th percentile: 2.9526823997497558
80th percentile: 3.2490593910217287
90th percentile: 5.311977028846735
95th percentile: 12.70849293470381
99th percentile: 18.6257056593895
mean time: 4.427773284912109
%s, retrying in %s seconds...
Received healthy response to inference request in 3.1304240226745605s
Received healthy response to inference request in 2.492119073867798s
Received healthy response to inference request in 2.8077754974365234s
Received healthy response to inference request in 3.140172004699707s
Received healthy response to inference request in 2.763913631439209s
Received healthy response to inference request in 2.119152784347534s
Received healthy response to inference request in 2.2332608699798584s
Received healthy response to inference request in 2.5533969402313232s
Received healthy response to inference request in 2.1541049480438232s
Received healthy response to inference request in 2.492419719696045s
10 requests
0 failed requests
5th percentile: 2.1348812580108643
10th percentile: 2.1506097316741943
20th percentile: 2.217429685592651
30th percentile: 2.414461612701416
40th percentile: 2.492299461364746
50th percentile: 2.522908329963684
60th percentile: 2.6376036167144776
70th percentile: 2.7770721912384033
80th percentile: 2.872305202484131
90th percentile: 3.131398820877075
95th percentile: 3.1357854127883913
99th percentile: 3.139294686317444
mean time: 2.588673949241638
Pipeline stage StressChecker completed in 72.81s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.04s
Shutdown handler de-registered
function_fehos_2025-12-16 status is now deployed due to DeploymentManager action
function_fehos_2025-12-16 status is now inactive due to auto deactivation removed underperforming models
function_fehos_2025-12-16 status is now torndown due to DeploymentManager action