developer_uid: chai_backend_admin
submission_id: function_dabek_2025-05-09
model_name: function_dabek_2025-05-09
model_group:
status: torndown
timestamp: 2025-05-09T02:30:55+00:00
num_battles: 6257
num_wins: 3153
celo_rating: 1289.29
family_friendly_score: 0.5522
family_friendly_standard_error: 0.007032427177013638
submission_type: function
display_name: function_dabek_2025-05-09
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-05-08
win_ratio: 0.5039156145117468
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.8882033824920654s
Received healthy response to inference request in 2.2601799964904785s
Received healthy response to inference request in 3.8384180068969727s
Received healthy response to inference request in 4.064933776855469s
Received healthy response to inference request in 3.195831298828125s
5 requests
0 failed requests
5th percentile: 1.962598705291748
10th percentile: 2.0369940280914305
20th percentile: 2.185784673690796
30th percentile: 2.4473102569580076
40th percentile: 2.8215707778930663
50th percentile: 3.195831298828125
60th percentile: 3.452865982055664
70th percentile: 3.709900665283203
80th percentile: 3.8837211608886717
90th percentile: 3.9743274688720702
95th percentile: 4.01963062286377
99th percentile: 4.055873146057129
mean time: 3.0495132923126222
%s, retrying in %s seconds...
Received healthy response to inference request in 3.405080556869507s
Received healthy response to inference request in 2.3294641971588135s
Received healthy response to inference request in 3.3219752311706543s
Received healthy response to inference request in 4.619634389877319s
Received healthy response to inference request in 3.7777698040008545s
5 requests
0 failed requests
5th percentile: 2.5279664039611816
10th percentile: 2.7264686107635496
20th percentile: 3.123473024368286
30th percentile: 3.338596296310425
40th percentile: 3.371838426589966
50th percentile: 3.405080556869507
60th percentile: 3.554156255722046
70th percentile: 3.703231954574585
80th percentile: 3.9461427211761477
90th percentile: 4.282888555526734
95th percentile: 4.4512614727020265
99th percentile: 4.58595980644226
mean time: 3.49078483581543
%s, retrying in %s seconds...
Received healthy response to inference request in 3.16550612449646s
Received healthy response to inference request in 3.0070323944091797s
Received healthy response to inference request in 3.2444205284118652s
Received healthy response to inference request in 2.8480277061462402s
Received healthy response to inference request in 1.8884344100952148s
5 requests
0 failed requests
5th percentile: 2.0803530693054197
10th percentile: 2.272271728515625
20th percentile: 2.6561090469360353
30th percentile: 2.8798286437988283
40th percentile: 2.943430519104004
50th percentile: 3.0070323944091797
60th percentile: 3.070421886444092
70th percentile: 3.133811378479004
80th percentile: 3.181289005279541
90th percentile: 3.212854766845703
95th percentile: 3.2286376476287844
99th percentile: 3.241263952255249
mean time: 2.830684232711792
Pipeline stage StressChecker completed in 50.57s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.77s
Shutdown handler de-registered
function_dabek_2025-05-09 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2863.53s
Shutdown handler de-registered
function_dabek_2025-05-09 status is now inactive due to auto deactivation removed underperforming models
function_dabek_2025-05-09 status is now torndown due to DeploymentManager action