submission_id: function_gofuk_2024-09-14
developer_uid: chai_backend_admin
celo_rating: 1258.99
display_name: dpo_with_ava_reward_50k_v1
family_friendly_score: 0.0
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.95, 'top_p': 1.0, 'min_p': 0.08, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '<|eot_id|>'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: dpo_with_ava_reward_50k_v1
num_battles: 18600
num_wins: 9305
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-09-14T20:59:44+00:00
us_pacific_date: 2024-09-14
win_ratio: 0.500268817204301
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.5085935592651367s
Received healthy response to inference request in 3.0430757999420166s
Received healthy response to inference request in 2.9974184036254883s
Received healthy response to inference request in 3.0830743312835693s
Received healthy response to inference request in 2.2160723209381104s
5 requests
0 failed requests
5th percentile: 2.372341537475586
10th percentile: 2.5286107540130613
20th percentile: 2.841149187088013
30th percentile: 3.0065498828887938
40th percentile: 3.024812841415405
50th percentile: 3.0430757999420166
60th percentile: 3.059075212478638
70th percentile: 3.075074625015259
80th percentile: 3.168178176879883
90th percentile: 3.3383858680725096
95th percentile: 3.423489713668823
99th percentile: 3.491572790145874
mean time: 2.9696468830108644
Pipeline stage StressChecker completed in 15.38s
Shutdown handler de-registered
function_gofuk_2024-09-14 status is now deployed due to DeploymentManager action
function_gofuk_2024-09-14 status is now inactive due to auto deactivation removed underperforming models
function_gofuk_2024-09-14 status is now torndown due to DeploymentManager action