developer_uid: chai_evaluation_service
submission_id: function_fikul_2025-12-16
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-19T16:51:15+00:00
num_battles: 10810
num_wins: 5332
celo_rating: 1288.71
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-19
win_ratio: 0.49324699352451434
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 5.2151360511779785s
Received healthy response to inference request in 4.18440055847168s
Received healthy response to inference request in 4.684653043746948s
Received healthy response to inference request in 3.3611090183258057s
Received healthy response to inference request in 3.317633628845215s
Received healthy response to inference request in 9.270363330841064s
Received healthy response to inference request in 3.9048001766204834s
Received healthy response to inference request in 3.676837205886841s
Received healthy response to inference request in 5.473354339599609s
10 requests
1 failed requests
5th percentile: 3.337197554111481
10th percentile: 3.3567614793777465
20th percentile: 3.613691568374634
30th percentile: 3.8364112854003904
40th percentile: 4.072560405731201
50th percentile: 4.434526801109314
60th percentile: 4.89684624671936
70th percentile: 5.292601537704468
80th percentile: 6.232756137847901
90th percentile: 10.383724188804623
95th percentile: 15.393848049640644
99th percentile: 19.40194713830948
mean time: 6.349225926399231
%s, retrying in %s seconds...
Received healthy response to inference request in 3.66192364692688s
Received healthy response to inference request in 3.821016311645508s
Received healthy response to inference request in 5.746405839920044s
Received healthy response to inference request in 6.0244529247283936s
Received healthy response to inference request in 4.050445318222046s
Received healthy response to inference request in 4.5084428787231445s
Received healthy response to inference request in 2.7402408123016357s
Received healthy response to inference request in 4.4005186557769775s
Received healthy response to inference request in 6.6700215339660645s
Received healthy response to inference request in 4.835821628570557s
10 requests
0 failed requests
5th percentile: 3.1549980878829955
10th percentile: 3.5697553634643553
20th percentile: 3.7891977787017823
30th percentile: 3.9816166162490845
40th percentile: 4.2604893207550045
50th percentile: 4.454480767250061
60th percentile: 4.639394378662109
70th percentile: 5.108996891975402
80th percentile: 5.802015256881714
90th percentile: 6.08900978565216
95th percentile: 6.379515659809112
99th percentile: 6.6119203591346745
mean time: 4.645928955078125
Pipeline stage StressChecker completed in 114.23s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.58s
Shutdown handler de-registered
function_fikul_2025-12-16 status is now deployed due to DeploymentManager action
function_fikul_2025-12-16 status is now inactive due to auto deactivation removed underperforming models
function_fikul_2025-12-16 status is now torndown due to DeploymentManager action