submission_id: function_temek_2024-08-26
developer_uid: chai_backend_admin
celo_rating: 1252.12
display_name: elo_alignment_tensorwave
family_friendly_score: 0.0
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.95, 'top_p': 1.0, 'min_p': 0.08, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '<|eot_id|>'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: elo_alignment_tensorwave
num_battles: 7414
num_wins: 3863
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-08-26T21:30:38+00:00
us_pacific_date: 2024-08-26
win_ratio: 0.5210412732667925
Resubmit model
Running pipeline stage StressChecker
Received healthy response to inference request in 4.820314407348633s
Received healthy response to inference request in 4.5436625480651855s
Received healthy response to inference request in 3.6861913204193115s
Received healthy response to inference request in 4.634779214859009s
Received healthy response to inference request in 5.672935485839844s
5 requests
0 failed requests
5th percentile: 3.8576855659484863
10th percentile: 4.029179811477661
20th percentile: 4.372168302536011
30th percentile: 4.56188588142395
40th percentile: 4.59833254814148
50th percentile: 4.634779214859009
60th percentile: 4.708993291854858
70th percentile: 4.783207368850708
80th percentile: 4.9908386230468755
90th percentile: 5.331887054443359
95th percentile: 5.502411270141601
99th percentile: 5.638830642700195
mean time: 4.671576595306396
Pipeline stage StressChecker completed in 24.29s
function_temek_2024-08-26 status is now deployed due to DeploymentManager action
function_temek_2024-08-26 status is now inactive due to admin request
Deleting key cycy233-l3-bp-v4-c3-v1/special_tokens_map.json from bucket guanaco-mkml-models
function_temek_2024-08-26 status is now torndown due to DeploymentManager action
function_temek_2024-08-26 status is now torndown due to DeploymentManager action