developer_uid: chai_backend_admin
submission_id: function_segeb_2025-05-23
model_name: function_segeb_2025-05-23
model_group:
status: torndown
timestamp: 2025-05-23T22:25:39+00:00
num_battles: 6191
num_wins: 3126
celo_rating: 1290.01
family_friendly_score: 0.525
family_friendly_standard_error: 0.007062223445912767
submission_type: function
display_name: function_segeb_2025-05-23
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-05-23
win_ratio: 0.5049265062187046
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.2118701934814453s
Received healthy response to inference request in 5.265947580337524s
Received healthy response to inference request in 3.170754909515381s
Received healthy response to inference request in 2.8000123500823975s
Received healthy response to inference request in 3.9366109371185303s
5 requests
0 failed requests
5th percentile: 2.8741608619689942
10th percentile: 2.948309373855591
20th percentile: 3.096606397628784
30th percentile: 3.1789779663085938
40th percentile: 3.1954240798950195
50th percentile: 3.2118701934814453
60th percentile: 3.501766490936279
70th percentile: 3.791662788391113
80th percentile: 4.20247826576233
90th percentile: 4.734212923049927
95th percentile: 5.000080251693725
99th percentile: 5.212774114608765
mean time: 3.6770391941070555
%s, retrying in %s seconds...
Received healthy response to inference request in 3.3875179290771484s
Received healthy response to inference request in 4.203691482543945s
Received healthy response to inference request in 2.7376909255981445s
Received healthy response to inference request in 1.7232332229614258s
Received healthy response to inference request in 4.676604509353638s
5 requests
0 failed requests
5th percentile: 1.9261247634887695
10th percentile: 2.129016304016113
20th percentile: 2.5347993850708006
30th percentile: 2.8676563262939454
40th percentile: 3.1275871276855467
50th percentile: 3.3875179290771484
60th percentile: 3.713987350463867
70th percentile: 4.040456771850586
80th percentile: 4.298274087905884
90th percentile: 4.487439298629761
95th percentile: 4.582021903991699
99th percentile: 4.65768798828125
mean time: 3.3457476139068603
%s, retrying in %s seconds...
Received healthy response to inference request in 3.3022589683532715s
Received healthy response to inference request in 3.267648458480835s
Received healthy response to inference request in 5.56719446182251s
Received healthy response to inference request in 2.3697192668914795s
Received healthy response to inference request in 3.174220561981201s
5 requests
0 failed requests
5th percentile: 2.5306195259094237
10th percentile: 2.691519784927368
20th percentile: 3.013320302963257
30th percentile: 3.192906141281128
40th percentile: 3.2302772998809814
50th percentile: 3.267648458480835
60th percentile: 3.2814926624298097
70th percentile: 3.295336866378784
80th percentile: 3.7552460670471195
90th percentile: 4.661220264434815
95th percentile: 5.114207363128662
99th percentile: 5.47659704208374
mean time: 3.5362083435058596
Pipeline stage StressChecker completed in 56.19s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.97s
Shutdown handler de-registered
function_segeb_2025-05-23 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3128.81s
Shutdown handler de-registered
function_segeb_2025-05-23 status is now inactive due to auto deactivation removed underperforming models
function_segeb_2025-05-23 status is now torndown due to DeploymentManager action