developer_uid: chai_backend_admin
submission_id: function_gibot_2024-09-25
model_name: reward_blend_default_full_bon
model_group:
status: torndown
timestamp: 2024-09-25T04:45:56+00:00
num_battles: 2780
num_wins: 1457
celo_rating: 1270.74
family_friendly_score: 0.5751658069270449
family_friendly_standard_error: 0.009465254364799473
submission_type: function
display_name: reward_blend_default_full_bon
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-09-24
win_ratio: 0.5241007194244605
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 50, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>', '<|user|>', '###'], 'max_input_tokens': 512, 'best_of': 4, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 7.1613030433654785s
Received healthy response to inference request in 6.445160627365112s
Received healthy response to inference request in 5.3286449909210205s
Received healthy response to inference request in 7.666306018829346s
Received healthy response to inference request in 8.652622699737549s
5 requests
0 failed requests
5th percentile: 5.551948118209839
10th percentile: 5.775251245498657
20th percentile: 6.221857500076294
30th percentile: 6.588389110565186
40th percentile: 6.874846076965332
50th percentile: 7.1613030433654785
60th percentile: 7.363304233551025
70th percentile: 7.565305423736572
80th percentile: 7.863569355010987
90th percentile: 8.258096027374268
95th percentile: 8.455359363555909
99th percentile: 8.613170032501221
mean time: 7.050807476043701
%s, retrying in %s seconds...
Received healthy response to inference request in 8.076951265335083s
Received healthy response to inference request in 5.67288875579834s
Received healthy response to inference request in 5.38700795173645s
Received healthy response to inference request in 5.121662378311157s
Received healthy response to inference request in 5.232770919799805s
5 requests
0 failed requests
5th percentile: 5.143884086608887
10th percentile: 5.166105794906616
20th percentile: 5.210549211502075
30th percentile: 5.263618326187133
40th percentile: 5.325313138961792
50th percentile: 5.38700795173645
60th percentile: 5.501360273361206
70th percentile: 5.615712594985962
80th percentile: 6.153701257705689
90th percentile: 7.115326261520386
95th percentile: 7.596138763427734
99th percentile: 7.980788764953613
mean time: 5.898256254196167
%s, retrying in %s seconds...
Received healthy response to inference request in 7.413663625717163s
Received healthy response to inference request in 4.561020374298096s
Received healthy response to inference request in 4.987641096115112s
Received healthy response to inference request in 7.747464895248413s
Received healthy response to inference request in 6.743650674819946s
5 requests
0 failed requests
5th percentile: 4.646344518661499
10th percentile: 4.7316686630249025
20th percentile: 4.902316951751709
30th percentile: 5.3388430118560795
40th percentile: 6.041246843338013
50th percentile: 6.743650674819946
60th percentile: 7.011655855178833
70th percentile: 7.279661035537719
80th percentile: 7.480423879623413
90th percentile: 7.613944387435913
95th percentile: 7.680704641342163
99th percentile: 7.734112844467163
mean time: 6.290688133239746
clean up pipeline due to error=%s
Shutdown handler de-registered
function_gibot_2024-09-25 status is now failed due to DeploymentManager action
function_gibot_2024-09-25 status is now inactive due to auto deactivation removed underperforming models
run pipeline %s
function_gibot_2024-09-25 status is now torndown due to DeploymentManager action