developer_uid: chai_backend_admin
submission_id: function_fides_2025-06-24
model_name: function_fides_2025-06-24
model_group:
status: torndown
timestamp: 2025-06-24T22:34:22+00:00
num_battles: 6248
num_wins: 3378
celo_rating: 1310.81
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: function_fides_2025-06-24
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-06-24
win_ratio: 0.5406530089628682
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.8178906440734863s
Received healthy response to inference request in 4.834307909011841s
Received healthy response to inference request in 5.6231231689453125s
Received healthy response to inference request in 4.616492986679077s
Received healthy response to inference request in 5.871973752975464s
5 requests
0 failed requests
5th percentile: 3.9776111125946043
10th percentile: 4.137331581115722
20th percentile: 4.456772518157959
30th percentile: 4.6600559711456295
40th percentile: 4.747181940078735
50th percentile: 4.834307909011841
60th percentile: 5.149834012985229
70th percentile: 5.465360116958618
80th percentile: 5.672893285751343
90th percentile: 5.772433519363403
95th percentile: 5.822203636169434
99th percentile: 5.862019729614258
mean time: 4.952757692337036
%s, retrying in %s seconds...
Received healthy response to inference request in 6.031524419784546s
Received healthy response to inference request in 5.13673734664917s
Received healthy response to inference request in 4.673620700836182s
Received healthy response to inference request in 5.1667468547821045s
Received healthy response to inference request in 5.0073442459106445s
5 requests
0 failed requests
5th percentile: 4.740365409851075
10th percentile: 4.807110118865967
20th percentile: 4.940599536895752
30th percentile: 5.03322286605835
40th percentile: 5.084980106353759
50th percentile: 5.13673734664917
60th percentile: 5.148741149902344
70th percentile: 5.160744953155517
80th percentile: 5.339702367782593
90th percentile: 5.685613393783569
95th percentile: 5.858568906784058
99th percentile: 5.996933317184448
mean time: 5.203194713592529
%s, retrying in %s seconds...
Received healthy response to inference request in 5.19548487663269s
Received healthy response to inference request in 5.043304204940796s
Received healthy response to inference request in 4.63812255859375s
Received healthy response to inference request in 4.59822678565979s
Received healthy response to inference request in 4.84490704536438s
5 requests
0 failed requests
5th percentile: 4.606205940246582
10th percentile: 4.614185094833374
20th percentile: 4.630143404006958
30th percentile: 4.679479455947876
40th percentile: 4.762193250656128
50th percentile: 4.84490704536438
60th percentile: 4.924265909194946
70th percentile: 5.003624773025512
80th percentile: 5.0737403392791744
90th percentile: 5.134612607955932
95th percentile: 5.165048742294312
99th percentile: 5.189397649765015
mean time: 4.864009094238281
clean up pipeline due to error=DeploymentChecksError('Unacceptable 70th percentile latency 5.003624773025512s')
Shutdown handler de-registered
function_fides_2025-06-24 status is now failed due to DeploymentManager action
function_fides_2025-06-24 status is now inactive due to auto deactivation removed underperforming models
function_fides_2025-06-24 status is now torndown due to DeploymentManager action