developer_uid: chai_backend_admin
submission_id: function_lurot_2025-04-09
model_name: function_lurot_2025-04-09
model_group:
status: torndown
timestamp: 2025-04-09T21:36:29+00:00
num_battles: 5916
num_wins: 2969
celo_rating: 1278.37
family_friendly_score: 0.5604
family_friendly_standard_error: 0.007019285433717595
submission_type: function
display_name: function_lurot_2025-04-09
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-04-09
win_ratio: 0.5018593644354293
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.894930124282837s
Received healthy response to inference request in 5.527308464050293s
Received healthy response to inference request in 4.597557783126831s
Received healthy response to inference request in 3.5690228939056396s
Received healthy response to inference request in 2.6507835388183594s
5 requests
0 failed requests
5th percentile: 2.0461008071899416
10th percentile: 2.197271490097046
20th percentile: 2.4996128559112547
30th percentile: 2.8344314098358154
40th percentile: 3.2017271518707275
50th percentile: 3.5690228939056396
60th percentile: 3.980436849594116
70th percentile: 4.391850805282592
80th percentile: 4.783507919311524
90th percentile: 5.155408191680908
95th percentile: 5.3413583278656
99th percentile: 5.490118436813354
mean time: 3.647920560836792
%s, retrying in %s seconds...
Received healthy response to inference request in 4.107318639755249s
Received healthy response to inference request in 5.391108751296997s
Received healthy response to inference request in 3.595090866088867s
Received healthy response to inference request in 4.330234050750732s
Received healthy response to inference request in 2.7345547676086426s
5 requests
0 failed requests
5th percentile: 2.9066619873046875
10th percentile: 3.0787692070007324
20th percentile: 3.4229836463928223
30th percentile: 3.6975364208221437
40th percentile: 3.9024275302886964
50th percentile: 4.107318639755249
60th percentile: 4.196484804153442
70th percentile: 4.285650968551636
80th percentile: 4.542408990859985
90th percentile: 4.966758871078492
95th percentile: 5.178933811187744
99th percentile: 5.348673763275147
mean time: 4.031661415100098
%s, retrying in %s seconds...
Received healthy response to inference request in 3.1679279804229736s
Received healthy response to inference request in 2.5543603897094727s
Received healthy response to inference request in 3.224095106124878s
Received healthy response to inference request in 5.192704439163208s
Received healthy response to inference request in 2.6491730213165283s
5 requests
0 failed requests
5th percentile: 2.5733229160308837
10th percentile: 2.5922854423522947
20th percentile: 2.6302104949951173
30th percentile: 2.752924013137817
40th percentile: 2.9604259967803954
50th percentile: 3.1679279804229736
60th percentile: 3.1903948307037355
70th percentile: 3.212861680984497
80th percentile: 3.617816972732544
90th percentile: 4.405260705947876
95th percentile: 4.798982572555541
99th percentile: 5.113960065841675
mean time: 3.357652187347412
Pipeline stage StressChecker completed in 58.35s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.65s
Shutdown handler de-registered
function_lurot_2025-04-09 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2957.07s
Shutdown handler de-registered
function_lurot_2025-04-09 status is now inactive due to auto deactivation removed underperforming models
function_lurot_2025-04-09 status is now torndown due to DeploymentManager action