developer_uid: chai_evaluation_service
submission_id: function_nimul_2025-12-15
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-18T18:51:21+00:00
num_battles: 10996
num_wins: 5477
celo_rating: 1291.81
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-18
win_ratio: 0.49809021462349945
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.1796317100524902s
Received healthy response to inference request in 3.0058040618896484s
Received healthy response to inference request in 2.7870733737945557s
Received healthy response to inference request in 2.176117420196533s
Received healthy response to inference request in 2.2358238697052s
Received healthy response to inference request in 1.9038524627685547s
Received healthy response to inference request in 2.033712387084961s
Received healthy response to inference request in 2.3983142375946045s
Received healthy response to inference request in 2.503065586090088s
10 requests
1 failed requests
5th percentile: 1.9622894287109376
10th percentile: 2.0207263946533205
20th percentile: 2.1476364135742188
30th percentile: 2.178577423095703
40th percentile: 2.213347005844116
50th percentile: 2.3170690536499023
60th percentile: 2.4402147769927978
70th percentile: 2.5882679224014282
80th percentile: 2.830819511413574
90th percentile: 4.721551299095148
95th percentile: 12.44241386651991
99th percentile: 18.61910392045975
mean time: 4.138667154312134
%s, retrying in %s seconds...
Received healthy response to inference request in 1.9568400382995605s
Received healthy response to inference request in 2.8850295543670654s
Received healthy response to inference request in 2.7269070148468018s
Received healthy response to inference request in 2.9499778747558594s
Received healthy response to inference request in 2.0151777267456055s
Received healthy response to inference request in 1.8610413074493408s
Received healthy response to inference request in 2.354712724685669s
Received healthy response to inference request in 2.5141584873199463s
Received healthy response to inference request in 2.9404566287994385s
Received healthy response to inference request in 1.9478347301483154s
10 requests
0 failed requests
5th percentile: 1.9000983476638793
10th percentile: 1.939155387878418
20th percentile: 1.9550389766693115
30th percentile: 1.997676420211792
40th percentile: 2.2188987255096437
50th percentile: 2.4344356060028076
60th percentile: 2.599257898330688
70th percentile: 2.7743437767028807
80th percentile: 2.89611496925354
90th percentile: 2.9414087533950806
95th percentile: 2.94569331407547
99th percentile: 2.9491209626197814
mean time: 2.41521360874176
Pipeline stage StressChecker completed in 69.35s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.70s
Shutdown handler de-registered
function_nimul_2025-12-15 status is now deployed due to DeploymentManager action
function_nimul_2025-12-15 status is now inactive due to auto deactivation removed underperforming models
function_nimul_2025-12-15 status is now torndown due to DeploymentManager action