developer_uid: chai_evaluation_service
submission_id: function_nulit_2025-12-15
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-18T21:51:21+00:00
num_battles: 11605
num_wins: 5757
celo_rating: 1290.59
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-18
win_ratio: 0.4960792761740629
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.35280704498291s
Received healthy response to inference request in 4.457514047622681s
Received healthy response to inference request in 2.2432596683502197s
Received healthy response to inference request in 2.9574248790740967s
Received healthy response to inference request in 3.829033374786377s
Received healthy response to inference request in 1.9621882438659668s
Received healthy response to inference request in 3.6693224906921387s
Received healthy response to inference request in 2.078477621078491s
Received healthy response to inference request in 2.331672191619873s
Received healthy response to inference request in 2.372300386428833s
10 requests
0 failed requests
5th percentile: 2.0145184636116027
10th percentile: 2.0668486833572386
20th percentile: 2.210303258895874
30th percentile: 2.3051484346389772
40th percentile: 2.3443531036376952
50th percentile: 2.3625537157058716
60th percentile: 2.606350183486938
70th percentile: 3.1709941625595093
80th percentile: 3.701264667510986
90th percentile: 3.891881442070007
95th percentile: 4.174697744846343
99th percentile: 4.400950787067414
mean time: 2.8253999948501587
Pipeline stage StressChecker completed in 29.92s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.08s
Shutdown handler de-registered
function_nulit_2025-12-15 status is now deployed due to DeploymentManager action
function_nulit_2025-12-15 status is now inactive due to auto deactivation removed underperforming models
function_nulit_2025-12-15 status is now torndown due to DeploymentManager action