developer_uid: chai_evaluation_service
submission_id: function_tufas_2025-12-15
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-18T14:21:18+00:00
num_battles: 10556
num_wins: 5310
celo_rating: 1295.25
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-18
win_ratio: 0.5030314513073134
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.000086784362793s
Received healthy response to inference request in 3.988713026046753s
Received healthy response to inference request in 1.6997723579406738s
Received healthy response to inference request in 1.9250411987304688s
Received healthy response to inference request in 2.3241055011749268s
Received healthy response to inference request in 2.331289529800415s
Received healthy response to inference request in 2.2423834800720215s
Received healthy response to inference request in 2.7415716648101807s
Received healthy response to inference request in 2.0459914207458496s
10 requests
1 failed requests
5th percentile: 1.8011433362960816
10th percentile: 1.9025143146514893
20th percentile: 1.9850776672363282
30th percentile: 2.0322200298309325
40th percentile: 2.163826656341553
50th percentile: 2.283244490623474
60th percentile: 2.3269791126251222
70th percentile: 2.454374170303345
80th percentile: 2.990999937057495
90th percentile: 5.600359106063837
95th percentile: 12.852766466140729
99th percentile: 18.654692354202272
mean time: 4.1404128789901735
%s, retrying in %s seconds...
Received healthy response to inference request in 1.9788968563079834s
Received healthy response to inference request in 2.0892977714538574s
Received healthy response to inference request in 1.6686060428619385s
Received healthy response to inference request in 2.8325490951538086s
Received healthy response to inference request in 2.2433202266693115s
Received healthy response to inference request in 2.250471830368042s
Received healthy response to inference request in 2.5999112129211426s
Received healthy response to inference request in 2.468390464782715s
Received healthy response to inference request in 2.2927944660186768s
Received healthy response to inference request in 1.7499032020568848s
10 requests
0 failed requests
5th percentile: 1.7051897644996643
10th percentile: 1.7417734861373901
20th percentile: 1.9330981254577637
30th percentile: 2.056177496910095
40th percentile: 2.1817112445831297
50th percentile: 2.2468960285186768
60th percentile: 2.267400884628296
70th percentile: 2.3454732656478883
80th percentile: 2.4946946144104003
90th percentile: 2.6231750011444093
95th percentile: 2.7278620481491087
99th percentile: 2.811611685752869
mean time: 2.217414116859436
Pipeline stage StressChecker completed in 67.73s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.08s
Shutdown handler de-registered
function_tufas_2025-12-15 status is now deployed due to DeploymentManager action
function_tufas_2025-12-15 status is now inactive due to auto deactivation removed underperforming models
function_tufas_2025-12-15 status is now torndown due to DeploymentManager action