submission_id: function_bugas_2024-10-13
developer_uid: chai_backend_admin
celo_rating: 1215.61
display_name: retune_with_base
family_friendly_score: 0.6306944444444444
family_friendly_standard_error: 0.005242903282331682
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.75, 'top_p': 1.0, 'min_p': 0.1, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '\n\n', '\nYou:', '[/INST]', '<|im_end|>', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 8858
num_wins: 4083
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-10-13T18:23:54+00:00
us_pacific_date: 2024-10-13
win_ratio: 0.46093926394219914
Download Preference Data
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.525437116622925s
Received healthy response to inference request in 2.2507145404815674s
Received healthy response to inference request in 2.2263879776000977s
Received healthy response to inference request in 1.8343980312347412s
Received healthy response to inference request in 2.371703624725342s
5 requests
0 failed requests
5th percentile: 1.9127960205078125
10th percentile: 1.9911940097808838
20th percentile: 2.1479899883270264
30th percentile: 2.2312532901763915
40th percentile: 2.2409839153289797
50th percentile: 2.2507145404815674
60th percentile: 2.299110174179077
70th percentile: 2.347505807876587
80th percentile: 2.4024503231048584
90th percentile: 2.4639437198638916
95th percentile: 2.494690418243408
99th percentile: 2.5192877769470217
mean time: 2.2417282581329347
Pipeline stage StressChecker completed in 13.67s
Shutdown handler de-registered
function_bugas_2024-10-13 status is now deployed due to DeploymentManager action
function_bugas_2024-10-13 status is now inactive due to auto deactivation removed underperforming models
function_bugas_2024-10-13 status is now torndown due to DeploymentManager action