developer_uid: chai_backend_admin
submission_id: function_siter_2025-04-08
model_name: function_siter_2025-04-08
model_group:
status: torndown
timestamp: 2025-04-08T19:54:57+00:00
num_battles: 6457
num_wins: 3245
celo_rating: 1286.27
family_friendly_score: 0.5622
family_friendly_standard_error: 0.007016140819567407
submission_type: function
display_name: function_siter_2025-04-08
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-04-08
win_ratio: 0.5025553662691652
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 8.54646611213684s
Received healthy response to inference request in 3.3980722427368164s
Received healthy response to inference request in 2.4816927909851074s
Received healthy response to inference request in 3.8742129802703857s
Received healthy response to inference request in 3.635038375854492s
5 requests
0 failed requests
5th percentile: 2.6649686813354494
10th percentile: 2.848244571685791
20th percentile: 3.2147963523864744
30th percentile: 3.4454654693603515
40th percentile: 3.540251922607422
50th percentile: 3.635038375854492
60th percentile: 3.7307082176208497
70th percentile: 3.826378059387207
80th percentile: 4.808663606643678
90th percentile: 6.677564859390259
95th percentile: 7.612015485763549
99th percentile: 8.359575986862183
mean time: 4.387096500396728
%s, retrying in %s seconds...
Received healthy response to inference request in 3.6151325702667236s
Received healthy response to inference request in 3.3399291038513184s
Received healthy response to inference request in 2.2649412155151367s
Received healthy response to inference request in 3.0755581855773926s
Received healthy response to inference request in 2.8611083030700684s
5 requests
0 failed requests
5th percentile: 2.384174633026123
10th percentile: 2.5034080505371095
20th percentile: 2.741874885559082
30th percentile: 2.903998279571533
40th percentile: 2.989778232574463
50th percentile: 3.0755581855773926
60th percentile: 3.181306552886963
70th percentile: 3.287054920196533
80th percentile: 3.3949697971343995
90th percentile: 3.5050511837005613
95th percentile: 3.5600918769836425
99th percentile: 3.6041244316101073
mean time: 3.031333875656128
Pipeline stage StressChecker completed in 39.17s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.94s
Shutdown handler de-registered
function_siter_2025-04-08 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3088.87s
Shutdown handler de-registered
function_siter_2025-04-08 status is now inactive due to auto deactivation removed underperforming models
function_siter_2025-04-08 status is now torndown due to DeploymentManager action