developer_uid: chai_evaluation_service
submission_id: function_neben_2025-12-15
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-18T02:11:19+00:00
num_battles: 8649
num_wins: 4268
celo_rating: 1288.7
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-17
win_ratio: 0.49346745288472654
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 3.9949727058410645s
Received healthy response to inference request in 3.1651837825775146s
Received healthy response to inference request in 1.9393458366394043s
Received healthy response to inference request in 6.857864141464233s
Received healthy response to inference request in 5.998589992523193s
Received healthy response to inference request in 2.089120864868164s
Received healthy response to inference request in 2.9893546104431152s
Received healthy response to inference request in 1.8535103797912598s
Received healthy response to inference request in 4.869632720947266s
10 requests
1 failed requests
5th percentile: 1.8921363353729248
10th percentile: 1.9307622909545898
20th percentile: 2.059165859222412
30th percentile: 2.7192844867706296
40th percentile: 3.094852113723755
50th percentile: 3.5800782442092896
60th percentile: 4.344836711883545
70th percentile: 5.208319902420044
80th percentile: 6.170444822311402
90th percentile: 8.191899442672725
95th percentile: 14.195058298110947
99th percentile: 18.99758538246155
mean time: 5.395579218864441
%s, retrying in %s seconds...
Received healthy response to inference request in 4.4399354457855225s
Received healthy response to inference request in 3.722935676574707s
Received healthy response to inference request in 3.1320738792419434s
Received healthy response to inference request in 3.0955400466918945s
Received healthy response to inference request in 2.9828426837921143s
Received healthy response to inference request in 5.510610580444336s
Received healthy response to inference request in 2.6302900314331055s
Received healthy response to inference request in 3.3101413249969482s
Received healthy response to inference request in 3.8452706336975098s
Received healthy response to inference request in 3.1865084171295166s
10 requests
0 failed requests
5th percentile: 2.7889387249946593
10th percentile: 2.947587418556213
20th percentile: 3.0730005741119384
30th percentile: 3.121113729476929
40th percentile: 3.1647346019744873
50th percentile: 3.2483248710632324
60th percentile: 3.4752590656280518
70th percentile: 3.759636163711548
80th percentile: 3.9642035961151123
90th percentile: 4.547002959251404
95th percentile: 5.0288067698478685
99th percentile: 5.414249818325043
mean time: 3.58561487197876
Pipeline stage StressChecker completed in 92.62s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.90s
Shutdown handler de-registered
function_neben_2025-12-15 status is now deployed due to DeploymentManager action
function_neben_2025-12-15 status is now inactive due to auto deactivation removed underperforming models
function_neben_2025-12-15 status is now torndown due to DeploymentManager action