function_gibot_2024-09-25

submission_id: function_gibot_2024-09-25

developer_uid: chai_backend_admin

celo_rating: 1270.74

display_name: reward_blend_default_full_bon

family_friendly_score: 0.5751658069270449

family_friendly_standard_error: 0.009465254364799473

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 50, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>', '<|user|>', '###'], 'max_input_tokens': 512, 'best_of': 4, 'max_output_tokens': 64}

is_internal_developer: True

model_group:

model_name: reward_blend_default_full_bon

num_battles: 2780

num_wins: 1457

ranking_group: single

status: torndown

submission_type: function

timestamp: 2024-09-25T04:45:56+00:00

us_pacific_date: 2024-09-24

win_ratio: 0.5241007194244605

Download Preference Data

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 7.1613030433654785s
Received healthy response to inference request in 6.445160627365112s
Received healthy response to inference request in 5.3286449909210205s
Received healthy response to inference request in 7.666306018829346s
Received healthy response to inference request in 8.652622699737549s
5 requests
0 failed requests
5th percentile: 5.551948118209839
10th percentile: 5.775251245498657
20th percentile: 6.221857500076294
30th percentile: 6.588389110565186
40th percentile: 6.874846076965332
50th percentile: 7.1613030433654785
60th percentile: 7.363304233551025
70th percentile: 7.565305423736572
80th percentile: 7.863569355010987
90th percentile: 8.258096027374268
95th percentile: 8.455359363555909
99th percentile: 8.613170032501221
mean time: 7.050807476043701
%s, retrying in %s seconds...
Received healthy response to inference request in 8.076951265335083s
Received healthy response to inference request in 5.67288875579834s
Received healthy response to inference request in 5.38700795173645s
Received healthy response to inference request in 5.121662378311157s
Received healthy response to inference request in 5.232770919799805s
5 requests
0 failed requests
5th percentile: 5.143884086608887
10th percentile: 5.166105794906616
20th percentile: 5.210549211502075
30th percentile: 5.263618326187133
40th percentile: 5.325313138961792
50th percentile: 5.38700795173645
60th percentile: 5.501360273361206
70th percentile: 5.615712594985962
80th percentile: 6.153701257705689
90th percentile: 7.115326261520386
95th percentile: 7.596138763427734
99th percentile: 7.980788764953613
mean time: 5.898256254196167
%s, retrying in %s seconds...
Received healthy response to inference request in 7.413663625717163s
Received healthy response to inference request in 4.561020374298096s
Received healthy response to inference request in 4.987641096115112s
Received healthy response to inference request in 7.747464895248413s
Received healthy response to inference request in 6.743650674819946s
5 requests
0 failed requests
5th percentile: 4.646344518661499
10th percentile: 4.7316686630249025
20th percentile: 4.902316951751709
30th percentile: 5.3388430118560795
40th percentile: 6.041246843338013
50th percentile: 6.743650674819946
60th percentile: 7.011655855178833
70th percentile: 7.279661035537719
80th percentile: 7.480423879623413
90th percentile: 7.613944387435913
95th percentile: 7.680704641342163
99th percentile: 7.734112844467163
mean time: 6.290688133239746
clean up pipeline due to error=%s
Shutdown handler de-registered
function_gibot_2024-09-25 status is now failed due to DeploymentManager action
function_gibot_2024-09-25 status is now inactive due to auto deactivation removed underperforming models
run pipeline %s
function_gibot_2024-09-25 status is now torndown due to DeploymentManager action