developer_uid: chai_evaluation_service
submission_id: function_damit_2025-12-15
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-18T08:21:19+00:00
num_battles: 7074
num_wins: 3619
celo_rating: 1301.27
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-18
win_ratio: 0.511591744416172
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.762822389602661s
Received healthy response to inference request in 2.168283700942993s
Received healthy response to inference request in 2.1125125885009766s
Received healthy response to inference request in 2.6223437786102295s
Received healthy response to inference request in 2.236881732940674s
Received healthy response to inference request in 2.8290083408355713s
Received healthy response to inference request in 2.5468156337738037s
Received healthy response to inference request in 3.0147318840026855s
Received healthy response to inference request in 2.358217716217041s
10 requests
1 failed requests
5th percentile: 2.137609589099884
10th percentile: 2.1627065896987916
20th percentile: 2.223162126541138
30th percentile: 2.321816921234131
40th percentile: 2.4713764667510985
50th percentile: 2.5845797061920166
60th percentile: 2.678535223007202
70th percentile: 2.782678174972534
80th percentile: 2.866153049468994
90th percentile: 4.732560086250299
95th percentile: 12.462786996364574
99th percentile: 18.646968524456028
mean time: 4.284463167190552
%s, retrying in %s seconds...
Received healthy response to inference request in 1.825831413269043s
Received healthy response to inference request in 1.8544516563415527s
Received healthy response to inference request in 3.028092861175537s
Received healthy response to inference request in 2.6220991611480713s
Received healthy response to inference request in 2.3867554664611816s
Received healthy response to inference request in 2.505786180496216s
Received healthy response to inference request in 3.9888620376586914s
Received healthy response to inference request in 2.3452632427215576s
Received healthy response to inference request in 1.7330818176269531s
Received healthy response to inference request in 1.8833656311035156s
10 requests
0 failed requests
5th percentile: 1.7748191356658936
10th percentile: 1.816556453704834
20th percentile: 1.8487276077270507
30th percentile: 1.8746914386749267
40th percentile: 2.160504198074341
50th percentile: 2.3660093545913696
60th percentile: 2.4343677520751954
70th percentile: 2.5406800746917724
80th percentile: 2.7032979011535647
90th percentile: 3.1241697788238523
95th percentile: 3.5565159082412707
99th percentile: 3.902392811775208
mean time: 2.417358946800232
Pipeline stage StressChecker completed in 69.93s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.58s
Shutdown handler de-registered
function_damit_2025-12-15 status is now deployed due to DeploymentManager action
function_damit_2025-12-15 status is now inactive due to auto deactivation removed underperforming models
function_damit_2025-12-15 status is now torndown due to DeploymentManager action