developer_uid: chai_evaluation_service
submission_id: function_potor_2025-12-14
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-17T18:26:29+00:00
num_battles: 9801
num_wins: 4842
celo_rating: 1256.39
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-14
win_ratio: 0.49403122130394855
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 6.187328577041626s
Received healthy response to inference request in 9.346741437911987s
Received healthy response to inference request in 7.724100112915039s
Received healthy response to inference request in 3.7864882946014404s
Received healthy response to inference request in 5.842392444610596s
Received healthy response to inference request in 1.777869462966919s
Received healthy response to inference request in 4.954354524612427s
Received healthy response to inference request in 3.1697654724121094s
Received healthy response to inference request in 5.443826675415039s
10 requests
1 failed requests
5th percentile: 2.4042226672172546
10th percentile: 3.0305758714675903
20th percentile: 3.6631437301635743
30th percentile: 4.603994655609131
40th percentile: 5.248037815093994
50th percentile: 5.643109560012817
60th percentile: 5.980366897583008
70th percentile: 6.648360037803649
80th percentile: 8.04862837791443
90th percentile: 10.422819328308101
95th percentile: 15.265169835090624
99th percentile: 19.139050240516664
mean time: 6.834038734436035
%s, retrying in %s seconds...
Received healthy response to inference request in 4.756794691085815s
Received healthy response to inference request in 8.69803524017334s
Received healthy response to inference request in 6.241685390472412s
Received healthy response to inference request in 4.506864309310913s
Received healthy response to inference request in 4.9387664794921875s
Received healthy response to inference request in 5.346905946731567s
Received healthy response to inference request in 5.340177536010742s
Received healthy response to inference request in 7.404134273529053s
Received healthy response to inference request in 5.994167804718018s
Received healthy response to inference request in 3.756061553955078s
10 requests
0 failed requests
5th percentile: 4.093922793865204
10th percentile: 4.43178403377533
20th percentile: 4.706808614730835
30th percentile: 4.884174942970276
40th percentile: 5.17961311340332
50th percentile: 5.343541741371155
60th percentile: 5.605810689926147
70th percentile: 6.068423080444336
80th percentile: 6.47417516708374
90th percentile: 7.533524370193481
95th percentile: 8.11577980518341
99th percentile: 8.581584153175355
mean time: 5.698359322547913
Pipeline stage StressChecker completed in 130.51s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.65s
Shutdown handler de-registered
function_potor_2025-12-14 status is now deployed due to DeploymentManager action
function_potor_2025-12-14 status is now inactive due to auto deactivation removed underperforming models
function_potor_2025-12-14 status is now torndown due to DeploymentManager action