developer_uid: chai_evaluation_service
submission_id: function_getam_2025-12-18
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-21T14:31:22+00:00
num_battles: 6920
num_wins: 3435
celo_rating: 1290.76
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-21
win_ratio: 0.4963872832369942
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.181318998336792s
Received healthy response to inference request in 3.1925179958343506s
Received healthy response to inference request in 1.8178563117980957s
Received healthy response to inference request in 3.0030651092529297s
Received healthy response to inference request in 2.390522003173828s
Received healthy response to inference request in 2.4194905757904053s
Received healthy response to inference request in 3.2273778915405273s
Received healthy response to inference request in 3.0097336769104004s
Received healthy response to inference request in 4.094383955001831s
Received healthy response to inference request in 1.7605223655700684s
10 requests
0 failed requests
5th percentile: 1.7863226413726807
10th percentile: 1.812122917175293
20th percentile: 2.2759888648986815
30th percentile: 2.410800004005432
40th percentile: 2.76963529586792
50th percentile: 3.006399393081665
60th percentile: 3.078367805480957
70th percentile: 3.1846786975860595
80th percentile: 3.199489974975586
90th percentile: 3.3140784978866575
95th percentile: 3.7042312264442434
99th percentile: 4.016353409290314
mean time: 2.809678888320923
Pipeline stage StressChecker completed in 29.93s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.89s
Shutdown handler de-registered
function_getam_2025-12-18 status is now deployed due to DeploymentManager action
function_getam_2025-12-18 status is now inactive due to auto deactivation removed underperforming models
function_getam_2025-12-18 status is now torndown due to DeploymentManager action