developer_uid: chai_evaluation_service
submission_id: function_pitan_2025-12-13
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-16T07:54:24+00:00
num_battles: 7867
num_wins: 3889
celo_rating: 1256.32
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-12
win_ratio: 0.4943434600228804
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 3.5448713302612305s
Received healthy response to inference request in 2.8465044498443604s
Received healthy response to inference request in 3.5398967266082764s
Received healthy response to inference request in 3.6591689586639404s
Received healthy response to inference request in 3.0836899280548096s
Received healthy response to inference request in 3.9754581451416016s
Received healthy response to inference request in 4.009944915771484s
Received healthy response to inference request in 3.677802562713623s
Received healthy response to inference request in 5.0582685470581055s
10 requests
1 failed requests
5th percentile: 2.9532379150390624
10th percentile: 3.0599713802337645
20th percentile: 3.448655366897583
30th percentile: 3.5433789491653442
40th percentile: 3.6134499073028565
50th percentile: 3.6684857606887817
60th percentile: 3.7968647956848143
70th percentile: 3.9858041763305665
80th percentile: 4.219609642028809
90th percentile: 6.562703371047968
95th percentile: 13.332660079002364
99th percentile: 18.748625445365906
mean time: 5.349822235107422
%s, retrying in %s seconds...
Received healthy response to inference request in 2.843567132949829s
Received healthy response to inference request in 1.9434783458709717s
Received healthy response to inference request in 2.9332571029663086s
Received healthy response to inference request in 2.9044833183288574s
Received healthy response to inference request in 4.629412651062012s
Received healthy response to inference request in 3.399129629135132s
Received healthy response to inference request in 3.2599852085113525s
Received healthy response to inference request in 3.984192371368408s
Received healthy response to inference request in 3.2117061614990234s
Received healthy response to inference request in 3.503580331802368s
10 requests
0 failed requests
5th percentile: 2.3485183000564573
10th percentile: 2.7535582542419434
20th percentile: 2.892300081253052
30th percentile: 2.924624967575073
40th percentile: 3.1003265380859375
50th percentile: 3.235845685005188
60th percentile: 3.315642976760864
70th percentile: 3.430464839935303
80th percentile: 3.599702739715576
90th percentile: 4.0487143993377686
95th percentile: 4.339063525199889
99th percentile: 4.571342825889587
mean time: 3.2612792253494263
Pipeline stage StressChecker completed in 90.08s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.75s
Shutdown handler de-registered
function_pitan_2025-12-13 status is now deployed due to DeploymentManager action
function_pitan_2025-12-13 status is now inactive due to auto deactivation removed underperforming models
function_pitan_2025-12-13 status is now torndown due to DeploymentManager action