developer_uid: chai_evaluation_service
submission_id: function_firaf_2025-12-18
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-21T18:51:19+00:00
num_battles: 9457
num_wins: 4659
celo_rating: 1288.01
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-21
win_ratio: 0.49265094638891826
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 3.287628412246704s
Received healthy response to inference request in 3.6634774208068848s
Received healthy response to inference request in 2.888092279434204s
Received healthy response to inference request in 1.7468633651733398s
Received healthy response to inference request in 2.6811916828155518s
Received healthy response to inference request in 1.9919283390045166s
Received healthy response to inference request in 2.5616700649261475s
Received healthy response to inference request in 2.3029394149780273s
Received healthy response to inference request in 2.3575172424316406s
10 requests
1 failed requests
5th percentile: 1.8571426033973695
10th percentile: 1.9674218416213989
20th percentile: 2.240737199783325
30th percentile: 2.3411438941955565
40th percentile: 2.480008935928345
50th percentile: 2.6214308738708496
60th percentile: 2.7639519214630126
70th percentile: 3.007953119277954
80th percentile: 3.3627982139587402
90th percentile: 5.308980965614313
95th percentile: 12.713746917247754
99th percentile: 18.63755967855454
mean time: 4.359982109069824
%s, retrying in %s seconds...
Received healthy response to inference request in 1.8975088596343994s
Received healthy response to inference request in 3.2177724838256836s
Received healthy response to inference request in 2.3194735050201416s
Received healthy response to inference request in 2.930164337158203s
Received healthy response to inference request in 2.5752627849578857s
Received healthy response to inference request in 2.489678144454956s
Received healthy response to inference request in 2.6546802520751953s
Received healthy response to inference request in 2.474632501602173s
Received healthy response to inference request in 2.869093179702759s
Received healthy response to inference request in 2.4038894176483154s
10 requests
0 failed requests
5th percentile: 2.0873929500579833
10th percentile: 2.277277040481567
20th percentile: 2.387006235122681
30th percentile: 2.4534095764160155
40th percentile: 2.4836598873138427
50th percentile: 2.532470464706421
60th percentile: 2.6070297718048097
70th percentile: 2.7190041303634644
80th percentile: 2.8813074111938475
90th percentile: 2.958925151824951
95th percentile: 3.088348817825317
99th percentile: 3.1918877506256105
mean time: 2.5832155466079714
Pipeline stage StressChecker completed in 72.56s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.76s
Shutdown handler de-registered
function_firaf_2025-12-18 status is now deployed due to DeploymentManager action
function_firaf_2025-12-18 status is now inactive due to auto deactivation removed underperforming models
function_firaf_2025-12-18 status is now torndown due to DeploymentManager action