developer_uid: chai_evaluation_service
submission_id: function_mubis_2025-12-14
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-17T18:01:17+00:00
num_battles: 8459
num_wins: 4248
celo_rating: 1256.41
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-14
win_ratio: 0.5021870197422863
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 7.2968950271606445s
Received healthy response to inference request in 11.658908128738403s
Received healthy response to inference request in 7.344953536987305s
Received healthy response to inference request in 7.406154632568359s
Received healthy response to inference request in 5.78581690788269s
Received healthy response to inference request in 3.594559669494629s
Received healthy response to inference request in 4.787446737289429s
Received healthy response to inference request in 2.4944851398468018s
Received healthy response to inference request in 13.525252103805542s
10 requests
1 failed requests
5th percentile: 2.989518678188324
10th percentile: 3.4845522165298464
20th percentile: 4.548869323730469
30th percentile: 5.486305856704711
40th percentile: 6.692463779449463
50th percentile: 7.320924282073975
60th percentile: 7.369433975219726
70th percentile: 8.681980681419372
80th percentile: 12.032176923751832
90th percentile: 14.182875704765317
95th percentile: 17.142181909084314
99th percentile: 19.50962687253952
mean time: 8.399595999717713
%s, retrying in %s seconds...
Received healthy response to inference request in 3.5994250774383545s
Received healthy response to inference request in 5.155807971954346s
Received healthy response to inference request in 9.282589673995972s
Received healthy response to inference request in 3.793975353240967s
Received healthy response to inference request in 3.8494150638580322s
Received healthy response to inference request in 2.1159157752990723s
Received healthy response to inference request in 9.962311267852783s
Received healthy response to inference request in 2.0565593242645264s
Received healthy response to inference request in 8.100250005722046s
Received healthy response to inference request in 6.069574356079102s
10 requests
0 failed requests
5th percentile: 2.083269727230072
10th percentile: 2.1099801301956176
20th percentile: 3.302723217010498
30th percentile: 3.735610270500183
40th percentile: 3.827239179611206
50th percentile: 4.502611517906189
60th percentile: 5.5213145256042475
70th percentile: 6.678777050971984
80th percentile: 8.33671793937683
90th percentile: 9.350561833381652
95th percentile: 9.656436550617217
99th percentile: 9.90113632440567
mean time: 5.39858238697052
Pipeline stage StressChecker completed in 140.74s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.60s
Shutdown handler de-registered
function_mubis_2025-12-14 status is now deployed due to DeploymentManager action
function_mubis_2025-12-14 status is now inactive due to auto deactivation removed underperforming models
function_mubis_2025-12-14 status is now torndown due to DeploymentManager action