submission_id: function_gidos_2024-10-21
developer_uid: chai_backend_admin
celo_rating: 1122.19
display_name: retune_with_base
family_friendly_score: 0.6332718705183364
family_friendly_standard_error: 0.005314141526257446
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 8726
num_wins: 3106
ranking_group: single
status: inactive
submission_type: function
timestamp: 2024-10-21T18:13:04+00:00
us_pacific_date: 2024-10-21
win_ratio: 0.35594774237909693
Download Preference Data
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.2177455425262451s
Received healthy response to inference request in 1.1337623596191406s
Received healthy response to inference request in 0.8187940120697021s
Received healthy response to inference request in 0.9023568630218506s
Received healthy response to inference request in 1.5014493465423584s
5 requests
0 failed requests
5th percentile: 0.8355065822601319
10th percentile: 0.8522191524505616
20th percentile: 0.8856442928314209
30th percentile: 0.9486379623413086
40th percentile: 1.0412001609802246
50th percentile: 1.1337623596191406
60th percentile: 1.1673556327819825
70th percentile: 1.2009489059448242
80th percentile: 1.2744863033294678
90th percentile: 1.387967824935913
95th percentile: 1.4447085857391357
99th percentile: 1.490101194381714
mean time: 1.1148216247558593
Pipeline stage StressChecker completed in 6.95s
Shutdown handler de-registered
function_gidos_2024-10-21 status is now deployed due to DeploymentManager action
function_gidos_2024-10-21 status is now inactive due to auto deactivation removed underperforming models