submission_id: function_sekub_2024-09-15
developer_uid: chai_backend_admin
alignment_samples: 48507
alignment_score: 1.40311154919395
celo_rating: 1129.13
display_name: mixtral_with_ava_reward_base
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 50, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>', '<|user|>', '###'], 'max_input_tokens': 512, 'best_of': 4, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: mixtral_with_ava_reward_base
num_battles: 48402
num_wins: 18215
propriety_score: 0.7416455404471076
propriety_total_count: 4339.0
ranking_group: single
status: inactive
submission_type: function
timestamp: 2024-09-15T01:36:03+00:00
us_pacific_date: 2024-09-14
win_ratio: 0.37632742448659146
Download Preference Data
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.5338237285614014s
Received healthy response to inference request in 2.748563528060913s
Received healthy response to inference request in 4.043041706085205s
Received healthy response to inference request in 3.3323891162872314s
Received healthy response to inference request in 2.393314838409424s
5 requests
0 failed requests
5th percentile: 2.4643645763397215
10th percentile: 2.5354143142700196
20th percentile: 2.6775137901306154
30th percentile: 2.865328645706177
40th percentile: 3.098858880996704
50th percentile: 3.3323891162872314
60th percentile: 3.4129629611968992
70th percentile: 3.4935368061065675
80th percentile: 3.635667324066162
90th percentile: 3.8393545150756836
95th percentile: 3.9411981105804443
99th percentile: 4.022672986984253
mean time: 3.210226583480835
Pipeline stage StressChecker completed in 18.91s
Shutdown handler de-registered
function_sekub_2024-09-15 status is now deployed due to DeploymentManager action
function_sekub_2024-09-15 status is now inactive due to auto deactivation removed underperforming models