submission_id: function_jahul_2024-09-14
developer_uid: chai_backend_admin
alignment_samples: 10175
alignment_score: -0.3069127300240561
celo_rating: 1185.12
display_name: dpo_with_ava_reward_650k_v1
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.95, 'top_p': 1.0, 'min_p': 0.08, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '<|eot_id|>'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: dpo_with_ava_reward_650k_v1
num_battles: 10175
num_wins: 4080
propriety_score: 0.7508571428571429
propriety_total_count: 875.0
ranking_group: single
status: inactive
submission_type: function
timestamp: 2024-09-14T20:32:43+00:00
us_pacific_date: 2024-09-14
win_ratio: 0.400982800982801
Download Preference Data
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.52040433883667s
Received healthy response to inference request in 2.1840732097625732s
Received healthy response to inference request in 2.2716729640960693s
Received healthy response to inference request in 1.4458367824554443s
Received healthy response to inference request in 1.6093006134033203s
5 requests
0 failed requests
5th percentile: 1.4607502937316894
10th percentile: 1.4756638050079345
20th percentile: 1.5054908275604248
30th percentile: 1.53818359375
40th percentile: 1.5737421035766601
50th percentile: 1.6093006134033203
60th percentile: 1.8392096519470214
70th percentile: 2.0691186904907224
80th percentile: 2.2015931606292725
90th percentile: 2.236633062362671
95th percentile: 2.25415301322937
99th percentile: 2.2681689739227293
mean time: 1.8062575817108155
Pipeline stage StressChecker completed in 10.58s
Shutdown handler de-registered
function_jahul_2024-09-14 status is now deployed due to DeploymentManager action
function_jahul_2024-09-14 status is now inactive due to auto deactivation removed underperforming models