developer_uid: chai_backend_admin
submission_id: function_robur_2025-06-25
model_name: function_robur_2025-06-25
model_group:
status: torndown
timestamp: 2025-06-25T20:36:08+00:00
num_battles: 6877
num_wins: 3475
celo_rating: 1297.55
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: function_robur_2025-06-25
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-06-25
win_ratio: 0.5053075468954485
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 6.916427135467529s
Received healthy response to inference request in 8.502779245376587s
Received healthy response to inference request in 4.435333251953125s
Received healthy response to inference request in 4.164880275726318s
Received healthy response to inference request in 4.142082214355469s
5 requests
0 failed requests
5th percentile: 4.146641826629638
10th percentile: 4.151201438903809
20th percentile: 4.160320663452149
30th percentile: 4.218970870971679
40th percentile: 4.327152061462402
50th percentile: 4.435333251953125
60th percentile: 5.427770805358886
70th percentile: 6.420208358764648
80th percentile: 7.233697557449341
90th percentile: 7.868238401412964
95th percentile: 8.185508823394775
99th percentile: 8.439325160980225
mean time: 5.6323004245758055
%s, retrying in %s seconds...
Received healthy response to inference request in 4.031639814376831s
Received healthy response to inference request in 4.021917343139648s
Received healthy response to inference request in 4.444554805755615s
Received healthy response to inference request in 4.054832935333252s
Received healthy response to inference request in 4.1081321239471436s
5 requests
0 failed requests
5th percentile: 4.023861837387085
10th percentile: 4.025806331634522
20th percentile: 4.029695320129394
30th percentile: 4.036278438568115
40th percentile: 4.045555686950683
50th percentile: 4.054832935333252
60th percentile: 4.076152610778808
70th percentile: 4.097472286224365
80th percentile: 4.175416660308838
90th percentile: 4.309985733032226
95th percentile: 4.377270269393921
99th percentile: 4.4310978984832765
mean time: 4.132215404510498
%s, retrying in %s seconds...
Received healthy response to inference request in 3.9986073970794678s
Received healthy response to inference request in 3.982076406478882s
Received healthy response to inference request in 4.181365013122559s
Received healthy response to inference request in 3.760941982269287s
Received healthy response to inference request in 4.322234869003296s
5 requests
0 failed requests
5th percentile: 3.805168867111206
10th percentile: 3.849395751953125
20th percentile: 3.937849521636963
30th percentile: 3.985382604598999
40th percentile: 3.9919950008392333
50th percentile: 3.9986073970794678
60th percentile: 4.071710443496704
70th percentile: 4.144813489913941
80th percentile: 4.209538984298706
90th percentile: 4.265886926651001
95th percentile: 4.294060897827149
99th percentile: 4.316600074768067
mean time: 4.049045133590698
clean up pipeline due to error=DeploymentChecksError('Unacceptable 70th percentile latency 4.144813489913941s')
Shutdown handler de-registered
function_robur_2025-06-25 status is now failed due to DeploymentManager action
function_robur_2025-06-25 status is now inactive due to auto deactivation removed underperforming models
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3945.54s
Shutdown handler de-registered
function_robur_2025-06-25 status is now torndown due to DeploymentManager action