submission_id: function_mibek_2024-09-14
developer_uid: chai_backend_admin
celo_rating: 1262.5
display_name: dpo_with_ava_reward_100k_v1
family_friendly_score: 0.0
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.95, 'top_p': 1.0, 'min_p': 0.08, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '<|eot_id|>'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: dpo_with_ava_reward_100k_v1
num_battles: 10676
num_wins: 5459
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-09-14T21:03:30+00:00
us_pacific_date: 2024-09-14
win_ratio: 0.5113338328962158
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.5951783657073975s
Received healthy response to inference request in 4.3040008544921875s
Received healthy response to inference request in 4.800174713134766s
Received healthy response to inference request in 5.0980517864227295s
Received healthy response to inference request in 4.15441107749939s
5 requests
0 failed requests
5th percentile: 2.9070249080657957
10th percentile: 3.2188714504241944
20th percentile: 3.8425645351409914
30th percentile: 4.184329032897949
40th percentile: 4.244164943695068
50th percentile: 4.3040008544921875
60th percentile: 4.502470397949219
70th percentile: 4.70093994140625
80th percentile: 4.859750127792358
90th percentile: 4.978900957107544
95th percentile: 5.038476371765137
99th percentile: 5.086136703491211
mean time: 4.190363359451294
Pipeline stage StressChecker completed in 21.51s
Shutdown handler de-registered
function_mibek_2024-09-14 status is now deployed due to DeploymentManager action
function_mibek_2024-09-14 status is now inactive due to auto deactivation removed underperforming models
function_mibek_2024-09-14 status is now torndown due to DeploymentManager action