developer_uid: chai_evaluation_service
submission_id: function_sasut_2025-12-15
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-18T23:21:17+00:00
num_battles: 9619
num_wins: 4765
celo_rating: 1290.05
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-18
win_ratio: 0.4953737394739578
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.812664270401001s
Received healthy response to inference request in 2.2437870502471924s
Received healthy response to inference request in 2.374462366104126s
Received healthy response to inference request in 2.4945061206817627s
Received healthy response to inference request in 2.4197301864624023s
Received healthy response to inference request in 2.127920627593994s
Received healthy response to inference request in 1.9391109943389893s
Received healthy response to inference request in 2.9116604328155518s
Received healthy response to inference request in 2.0033669471740723s
Received healthy response to inference request in 2.0829732418060303s
10 requests
0 failed requests
5th percentile: 1.9680261731147766
10th percentile: 1.9969413518905639
20th percentile: 2.0670519828796388
30th percentile: 2.114436411857605
40th percentile: 2.197440481185913
50th percentile: 2.309124708175659
60th percentile: 2.3925694942474367
70th percentile: 2.4421629667282105
80th percentile: 2.5581377506256104
90th percentile: 2.822563886642456
95th percentile: 2.867112159729004
99th percentile: 2.902750778198242
mean time: 2.341018223762512
Pipeline stage StressChecker completed in 24.86s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.62s
Shutdown handler de-registered
function_sasut_2025-12-15 status is now deployed due to DeploymentManager action
function_sasut_2025-12-15 status is now inactive due to auto deactivation removed underperforming models
function_sasut_2025-12-15 status is now torndown due to DeploymentManager action