developer_uid: chai_evaluation_service
submission_id: function_temos_2025-12-18
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-21T14:41:05+00:00
num_battles: 9448
num_wins: 4720
celo_rating: 1293.26
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-21
win_ratio: 0.4995766299745978
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 1.8491976261138916s
Received healthy response to inference request in 2.3778774738311768s
Received healthy response to inference request in 2.0113797187805176s
Received healthy response to inference request in 2.3471455574035645s
Received healthy response to inference request in 1.8850946426391602s
Received healthy response to inference request in 2.306596040725708s
Received healthy response to inference request in 1.9919264316558838s
Received healthy response to inference request in 2.5464086532592773s
Received healthy response to inference request in 1.8300678730010986s
10 requests
1 failed requests
5th percentile: 1.8386762619018555
10th percentile: 1.8472846508026124
20th percentile: 1.8779152393341065
30th percentile: 1.9598768949508667
40th percentile: 2.0035984039306642
50th percentile: 2.158987879753113
60th percentile: 2.3228158473968508
70th percentile: 2.356365132331848
80th percentile: 2.4115837097167967
90th percentile: 4.3009398937225285
95th percentile: 12.196330475807171
99th percentile: 18.512642941474915
mean time: 3.9237415075302122
%s, retrying in %s seconds...
Received healthy response to inference request in 2.4264047145843506s
Received healthy response to inference request in 2.586374044418335s
Received healthy response to inference request in 2.3845865726470947s
Received healthy response to inference request in 2.1291491985321045s
Received healthy response to inference request in 1.6166841983795166s
Received healthy response to inference request in 2.3091866970062256s
Received healthy response to inference request in 1.6703941822052002s
Received healthy response to inference request in 2.113872528076172s
Received healthy response to inference request in 2.662458658218384s
Received healthy response to inference request in 3.239574670791626s
10 requests
0 failed requests
5th percentile: 1.6408536911010743
10th percentile: 1.665023183822632
20th percentile: 2.0251768589019776
30th percentile: 2.1245661973953247
40th percentile: 2.237171697616577
50th percentile: 2.34688663482666
60th percentile: 2.401313829421997
70th percentile: 2.474395513534546
80th percentile: 2.601590967178345
90th percentile: 2.720170259475708
95th percentile: 2.9798724651336665
99th percentile: 3.187634229660034
mean time: 2.313868546485901
Pipeline stage StressChecker completed in 64.97s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.76s
Shutdown handler de-registered
function_temos_2025-12-18 status is now deployed due to DeploymentManager action
function_temos_2025-12-18 status is now inactive due to auto deactivation removed underperforming models
function_temos_2025-12-18 status is now torndown due to DeploymentManager action