developer_uid: chai_evaluation_service
submission_id: function_dojaf_2025-12-16
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-19T15:51:19+00:00
num_battles: 10272
num_wins: 5094
celo_rating: 1290.41
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-19
win_ratio: 0.495911214953271
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 6.518782377243042s
Received healthy response to inference request in 5.198678731918335s
Received healthy response to inference request in 4.387730121612549s
Received healthy response to inference request in 3.607316255569458s
Received healthy response to inference request in 4.863557815551758s
Received healthy response to inference request in 5.450475215911865s
Received healthy response to inference request in 4.519262313842773s
Received healthy response to inference request in 6.910129547119141s
Received healthy response to inference request in 2.7954673767089844s
10 requests
1 failed requests
5th percentile: 3.1607993721961973
10th percentile: 3.5261313676834107
20th percentile: 4.23164734840393
30th percentile: 4.479802656173706
40th percentile: 4.725839614868164
50th percentile: 5.031118273735046
60th percentile: 5.299397325515747
70th percentile: 5.770967364311218
80th percentile: 6.597051811218262
90th percentile: 8.230084896087641
95th percentile: 14.169883966445909
99th percentile: 18.921723222732545
mean time: 6.43610827922821
%s, retrying in %s seconds...
Received healthy response to inference request in 3.819897174835205s
Received healthy response to inference request in 3.7870514392852783s
Received healthy response to inference request in 1.8751201629638672s
Received healthy response to inference request in 8.474161624908447s
Received healthy response to inference request in 2.989361047744751s
Received healthy response to inference request in 3.609248161315918s
Received healthy response to inference request in 3.695084571838379s
Received healthy response to inference request in 6.436054229736328s
Received healthy response to inference request in 6.6867969036102295s
Received healthy response to inference request in 3.8237252235412598s
10 requests
0 failed requests
5th percentile: 2.376528561115265
10th percentile: 2.8779369592666626
20th percentile: 3.4852707386016846
30th percentile: 3.669333648681641
40th percentile: 3.7502646923065184
50th percentile: 3.8034743070602417
60th percentile: 3.821428394317627
70th percentile: 4.60742392539978
80th percentile: 6.486202764511108
90th percentile: 6.865533375740051
95th percentile: 7.669847500324248
99th percentile: 8.313298799991609
mean time: 4.5196500539779665
Pipeline stage StressChecker completed in 112.53s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.11s
Shutdown handler de-registered
function_dojaf_2025-12-16 status is now deployed due to DeploymentManager action
function_dojaf_2025-12-16 status is now inactive due to auto deactivation removed underperforming models
function_dojaf_2025-12-16 status is now torndown due to DeploymentManager action