developer_uid: chai_evaluation_service
submission_id: function_pejus_2025-12-18
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-21T05:21:17+00:00
num_battles: 8279
num_wins: 4058
celo_rating: 1286.43
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-20
win_ratio: 0.49015581591979707
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.4760310649871826s
Received healthy response to inference request in 1.8941764831542969s
Received healthy response to inference request in 2.431225538253784s
Received healthy response to inference request in 2.825479030609131s
Received healthy response to inference request in 2.430569648742676s
Received healthy response to inference request in 2.2276434898376465s
Received healthy response to inference request in 2.018587350845337s
Received healthy response to inference request in 1.9629526138305664s
Received healthy response to inference request in 2.801210641860962s
10 requests
1 failed requests
5th percentile: 1.925125741958618
10th percentile: 1.9560750007629395
20th percentile: 2.0074604034423826
30th percentile: 2.1649266481399536
40th percentile: 2.349399185180664
50th percentile: 2.43089759349823
60th percentile: 2.4491477489471434
70th percentile: 2.5735849380493163
80th percentile: 2.806064319610596
90th percentile: 4.554256510734552
95th percentile: 12.333755171298963
99th percentile: 18.557354099750523
mean time: 4.118112969398498
%s, retrying in %s seconds...
Received healthy response to inference request in 3.8376545906066895s
Received healthy response to inference request in 2.938035011291504s
Received healthy response to inference request in 1.784304141998291s
Received healthy response to inference request in 1.8887295722961426s
Received healthy response to inference request in 2.0816433429718018s
Received healthy response to inference request in 1.970186710357666s
Received healthy response to inference request in 1.939467191696167s
Received healthy response to inference request in 2.2452781200408936s
Received healthy response to inference request in 3.1024398803710938s
Received healthy response to inference request in 2.703070640563965s
10 requests
0 failed requests
5th percentile: 1.8312955856323243
10th percentile: 1.8782870292663574
20th percentile: 1.9293196678161622
30th percentile: 1.9609708547592164
40th percentile: 2.0370606899261476
50th percentile: 2.1634607315063477
60th percentile: 2.4283951282501217
70th percentile: 2.7735599517822265
80th percentile: 2.970915985107422
90th percentile: 3.175961351394653
95th percentile: 3.5068079710006708
99th percentile: 3.771485266685486
mean time: 2.4490809202194215
Pipeline stage StressChecker completed in 68.88s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.97s
Shutdown handler de-registered
function_pejus_2025-12-18 status is now deployed due to DeploymentManager action
function_pejus_2025-12-18 status is now inactive due to auto deactivation removed underperforming models
function_pejus_2025-12-18 status is now torndown due to DeploymentManager action