submission_id: function_dahus_2024-09-14
developer_uid: chai_backend_admin
alignment_samples: 77860
alignment_score: 0.7209457716396527
celo_rating: 1214.01
display_name: mixtral_with_ava_reward_base
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 50, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>', '<|user|>', '###'], 'max_input_tokens': 512, 'best_of': 4, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: mixtral_with_ava_reward_base
num_battles: 77727
num_wins: 41441
propriety_score: 0.7443706697459584
propriety_total_count: 6928.0
ranking_group: single
status: inactive
submission_type: function
timestamp: 2024-09-14T23:59:48+00:00
us_pacific_date: 2024-09-14
win_ratio: 0.5331609350676084
Download Preference Data
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.79447340965271s
Failed to get response for submission blend_hokok_2024-09-09: ('http://neversleep-noromaid-v0-8068-v150-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Received healthy response to inference request in 4.486905813217163s
Received healthy response to inference request in 4.033170938491821s
Received healthy response to inference request in 3.058868408203125s
Received healthy response to inference request in 3.7053158283233643s
5 requests
0 failed requests
5th percentile: 3.188157892227173
10th percentile: 3.317447376251221
20th percentile: 3.5760263442993163
30th percentile: 3.7231473445892336
40th percentile: 3.7588103771209718
50th percentile: 3.79447340965271
60th percentile: 3.8899524211883545
70th percentile: 3.985431432723999
80th percentile: 4.123917913436889
90th percentile: 4.305411863327026
95th percentile: 4.396158838272095
99th percentile: 4.46875641822815
mean time: 3.815746879577637
Pipeline stage StressChecker completed in 20.02s
Shutdown handler de-registered
function_dahus_2024-09-14 status is now deployed due to DeploymentManager action
function_dahus_2024-09-14 status is now inactive due to auto deactivation removed underperforming models