developer_uid: chai_backend_admin
submission_id: function_hujas_2025-03-24
model_name: function_hujas_2025-03-24
model_group:
status: torndown
timestamp: 2025-03-24T18:15:58+00:00
num_battles: 6330
num_wins: 3322
celo_rating: 1289.89
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: function_hujas_2025-03-24
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-03-24
win_ratio: 0.5248025276461296
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 6.174391984939575s
Received healthy response to inference request in 4.016283273696899s
Received healthy response to inference request in 3.3252713680267334s
Received healthy response to inference request in 3.8502464294433594s
Received healthy response to inference request in 3.4702188968658447s
5 requests
0 failed requests
5th percentile: 3.354260873794556
10th percentile: 3.383250379562378
20th percentile: 3.4412293910980223
30th percentile: 3.5462244033813475
40th percentile: 3.6982354164123534
50th percentile: 3.8502464294433594
60th percentile: 3.9166611671447753
70th percentile: 3.9830759048461912
80th percentile: 4.447905015945435
90th percentile: 5.311148500442505
95th percentile: 5.74277024269104
99th percentile: 6.0880676364898685
mean time: 4.167282390594482
%s, retrying in %s seconds...
Received healthy response to inference request in 3.903961181640625s
Received healthy response to inference request in 5.275036811828613s
Received healthy response to inference request in 4.371051788330078s
Received healthy response to inference request in 4.471301317214966s
Received healthy response to inference request in 4.154999017715454s
5 requests
0 failed requests
5th percentile: 3.954168748855591
10th percentile: 4.004376316070557
20th percentile: 4.104791450500488
30th percentile: 4.198209571838379
40th percentile: 4.284630680084229
50th percentile: 4.371051788330078
60th percentile: 4.411151599884033
70th percentile: 4.451251411437989
80th percentile: 4.632048416137695
90th percentile: 4.953542613983155
95th percentile: 5.114289712905884
99th percentile: 5.242887392044067
mean time: 4.435270023345947
%s, retrying in %s seconds...
Received healthy response to inference request in 3.705693483352661s
Received healthy response to inference request in 2.5732927322387695s
Received healthy response to inference request in 3.770439386367798s
Received healthy response to inference request in 3.675616979598999s
Received healthy response to inference request in 4.398930549621582s
5 requests
0 failed requests
5th percentile: 2.7937575817108153
10th percentile: 3.014222431182861
20th percentile: 3.455152130126953
30th percentile: 3.6816322803497314
40th percentile: 3.6936628818511963
50th percentile: 3.705693483352661
60th percentile: 3.7315918445587157
70th percentile: 3.7574902057647703
80th percentile: 3.8961376190185546
90th percentile: 4.1475340843200685
95th percentile: 4.273232316970825
99th percentile: 4.373790903091431
mean time: 3.624794626235962
clean up pipeline due to error=DeploymentChecksError('Unacceptable 70th percentile latency 3.7574902057647703s')
Shutdown handler de-registered
function_hujas_2025-03-24 status is now failed due to DeploymentManager action
function_hujas_2025-03-24 status is now inactive due to auto deactivation removed underperforming models
function_hujas_2025-03-24 status is now torndown due to DeploymentManager action