function_nesen_2024-09-14

submission_id: function_nesen_2024-09-14

developer_uid: chai_backend_admin

alignment_samples: 32755

alignment_score: 0.6745545521357516

celo_rating: 1213.79

display_name: mixtral_with_ava_reward_50k_v1

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 50, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>', '<|user|>', '###'], 'max_input_tokens': 512, 'best_of': 4, 'max_output_tokens': 64}

is_internal_developer: True

model_group:

model_name: mixtral_with_ava_reward_50k_v1

num_battles: 32735

num_wins: 16244

propriety_score: 0.734561583077448

propriety_total_count: 2931.0

ranking_group: single

status: inactive

submission_type: function

timestamp: 2024-09-14T23:56:39+00:00

us_pacific_date: 2024-09-14

win_ratio: 0.4962272796700779

Download Preference Data

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 4.0454723834991455s
Received healthy response to inference request in 1.9702539443969727s
Received healthy response to inference request in 2.3675613403320312s
Received healthy response to inference request in 2.366163730621338s
Failed to get response for submission blend_hokok_2024-09-09: ('http://neversleep-noromaid-v0-8068-v150-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Received healthy response to inference request in 3.8996989727020264s
5 requests
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
0 failed requests
Connection pool is full, discarding connection: %s. Connection pool size: %s
5th percentile: 2.0494359016418455
10th percentile: 2.128617858886719
20th percentile: 2.286981773376465
30th percentile: 2.3664432525634767
40th percentile: 2.3670022964477537
50th percentile: 2.3675613403320312
60th percentile: 2.980416393280029
70th percentile: 3.593271446228027
80th percentile: 3.92885365486145
90th percentile: 3.987163019180298
95th percentile: 4.016317701339721
99th percentile: 4.039641447067261
mean time: 2.9298300743103027
Pipeline stage StressChecker completed in 31.62s
Shutdown handler de-registered
function_nesen_2024-09-14 status is now deployed due to DeploymentManager action
function_nesen_2024-09-14 status is now inactive due to auto deactivation removed underperforming models