developer_uid: chai_backend_admin
submission_id: function_sifuk_2025-03-24
model_name: function_sifuk_2025-03-24
model_group:
status: torndown
timestamp: 2025-03-24T18:16:24+00:00
num_battles: 6247
num_wins: 3243
celo_rating: 1283.88
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: function_sifuk_2025-03-24
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-03-24
win_ratio: 0.5191291820073636
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.0863940715789795s
Received healthy response to inference request in 3.3405685424804688s
Received healthy response to inference request in 3.804081439971924s
Received healthy response to inference request in 3.5065696239471436s
Received healthy response to inference request in 5.382528305053711s
5 requests
0 failed requests
5th percentile: 3.373768758773804
10th percentile: 3.4069689750671386
20th percentile: 3.4733694076538084
30th percentile: 3.5660719871520996
40th percentile: 3.6850767135620117
50th percentile: 3.804081439971924
60th percentile: 3.917006492614746
70th percentile: 4.029931545257568
80th percentile: 4.345620918273926
90th percentile: 4.864074611663819
95th percentile: 5.123301458358765
99th percentile: 5.330682935714722
mean time: 4.024028396606445
%s, retrying in %s seconds...
Received healthy response to inference request in 3.237630605697632s
Received healthy response to inference request in 4.1926634311676025s
Received healthy response to inference request in 3.0818867683410645s
Received healthy response to inference request in 18.41051173210144s
Received healthy response to inference request in 3.7778115272521973s
5 requests
0 failed requests
5th percentile: 3.113035535812378
10th percentile: 3.1441843032836916
20th percentile: 3.2064818382263183
30th percentile: 3.345666790008545
40th percentile: 3.5617391586303713
50th percentile: 3.7778115272521973
60th percentile: 3.9437522888183594
70th percentile: 4.1096930503845215
80th percentile: 7.036233091354372
90th percentile: 12.723372411727906
95th percentile: 15.56694207191467
99th percentile: 17.841797800064086
mean time: 6.540100812911987
%s, retrying in %s seconds...
Received healthy response to inference request in 4.619185447692871s
Received healthy response to inference request in 4.702490568161011s
Received healthy response to inference request in 3.7908380031585693s
Received healthy response to inference request in 4.4882283210754395s
Received healthy response to inference request in 5.049508333206177s
5 requests
0 failed requests
5th percentile: 3.9303160667419434
10th percentile: 4.069794130325318
20th percentile: 4.348750257492066
30th percentile: 4.514419746398926
40th percentile: 4.566802597045898
50th percentile: 4.619185447692871
60th percentile: 4.652507495880127
70th percentile: 4.685829544067383
80th percentile: 4.771894121170044
90th percentile: 4.9107012271881105
95th percentile: 4.980104780197143
99th percentile: 5.03562762260437
mean time: 4.530050134658813
clean up pipeline due to error=DeploymentChecksError('Unacceptable 70th percentile latency 4.685829544067383s')
Shutdown handler de-registered
function_sifuk_2025-03-24 status is now failed due to DeploymentManager action
function_sifuk_2025-03-24 status is now inactive due to auto deactivation removed underperforming models
function_sifuk_2025-03-24 status is now torndown due to DeploymentManager action