developer_uid: chai_evaluation_service
submission_id: function_tahuk_2025-12-16
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-19T01:31:18+00:00
num_battles: 7892
num_wins: 3938
celo_rating: 1292.61
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-18
win_ratio: 0.4989863152559554
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.2804462909698486s
Received healthy response to inference request in 1.7660856246948242s
Received healthy response to inference request in 2.8727290630340576s
Received healthy response to inference request in 3.2406861782073975s
Received healthy response to inference request in 2.1457014083862305s
Received healthy response to inference request in 1.8353049755096436s
Received healthy response to inference request in 2.0126752853393555s
Received healthy response to inference request in 2.5136146545410156s
Received healthy response to inference request in 1.802513837814331s
10 requests
1 failed requests
5th percentile: 1.7824783205986023
10th percentile: 1.7988710165023805
20th percentile: 1.828746747970581
30th percentile: 1.959464192390442
40th percentile: 2.0924909591674803
50th percentile: 2.2130738496780396
60th percentile: 2.3737136363983153
70th percentile: 2.6213489770889282
80th percentile: 2.9463204860687258
90th percentile: 4.928567075729364
95th percentile: 12.524031114578229
99th percentile: 18.60040234565735
mean time: 4.0589252471923825
%s, retrying in %s seconds...
Received healthy response to inference request in 3.168121337890625s
Received healthy response to inference request in 2.2343082427978516s
Received healthy response to inference request in 3.0989885330200195s
Received healthy response to inference request in 1.6556217670440674s
Received healthy response to inference request in 3.145134687423706s
Received healthy response to inference request in 1.7242350578308105s
Received healthy response to inference request in 2.3789212703704834s
Received healthy response to inference request in 2.3976802825927734s
Received healthy response to inference request in 2.08150577545166s
Received healthy response to inference request in 1.6622090339660645s
10 requests
0 failed requests
5th percentile: 1.658586037158966
10th percentile: 1.6615503072738647
20th percentile: 1.7118298530578613
30th percentile: 1.9743245601654051
40th percentile: 2.173187255859375
50th percentile: 2.3066147565841675
60th percentile: 2.3864248752593995
70th percentile: 2.6080727577209473
80th percentile: 3.1082177639007567
90th percentile: 3.147433352470398
95th percentile: 3.1577773451805116
99th percentile: 3.1660525393486023
mean time: 2.354672598838806
Pipeline stage StressChecker completed in 67.97s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.60s
Shutdown handler de-registered
function_tahuk_2025-12-16 status is now deployed due to DeploymentManager action
function_tahuk_2025-12-16 status is now inactive due to auto deactivation removed underperforming models
function_tahuk_2025-12-16 status is now torndown due to DeploymentManager action