developer_uid: chai_evaluation_service
submission_id: function_kegis_2025-12-16
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-19T16:21:24+00:00
num_battles: 10353
num_wins: 5235
celo_rating: 1297.09
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-19
win_ratio: 0.5056505360764996
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 8.993741273880005s
Received healthy response to inference request in 6.583327770233154s
Received healthy response to inference request in 5.351212739944458s
Received healthy response to inference request in 4.28784966468811s
Failed to get response for submission chaiml-2a6f-69d4-linear-w01_v7: HTTPConnectionPool(host='guanaco-model-mesh-load-balancer.model-mesh.k2.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
Received healthy response to inference request in 6.700459241867065s
Received healthy response to inference request in 4.656893968582153s
Received healthy response to inference request in 5.999964952468872s
Received healthy response to inference request in 6.021730899810791s
Received healthy response to inference request in 12.43528437614441s
Received healthy response to inference request in 10.541959285736084s
10 requests
0 failed requests
5th percentile: 4.45391960144043
10th percentile: 4.619989538192749
20th percentile: 5.212348985671997
30th percentile: 5.805339288711548
40th percentile: 6.013024520874024
50th percentile: 6.302529335021973
60th percentile: 6.630180358886719
70th percentile: 7.388443851470947
80th percentile: 9.30338487625122
90th percentile: 10.731291794776915
95th percentile: 11.58328808546066
99th percentile: 12.26488511800766
mean time: 7.15724241733551
Pipeline stage StressChecker completed in 73.50s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.64s
Shutdown handler de-registered
function_kegis_2025-12-16 status is now deployed due to DeploymentManager action
function_kegis_2025-12-16 status is now inactive due to auto deactivation removed underperforming models
function_kegis_2025-12-16 status is now torndown due to DeploymentManager action