submission_id: function_hogob_2024-10-01
developer_uid: chai_backend_admin
celo_rating: 1265.54
display_name: retune_with_base
family_friendly_score: 0.5740147544166181
family_friendly_standard_error: 0.00840953420516893
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 3545
num_wins: 1831
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-10-01T03:05:09+00:00
us_pacific_date: 2024-09-30
win_ratio: 0.5165021156558534
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.7732372283935547s
Received healthy response to inference request in 3.1145591735839844s
Received healthy response to inference request in 4.3076324462890625s
Received healthy response to inference request in 3.621340036392212s
Received healthy response to inference request in 3.794473171234131s
Received healthy response to inference request in 3.8285200595855713s
Received healthy response to inference request in 3.988645076751709s
Received healthy response to inference request in 3.80531644821167s
Received healthy response to inference request in 3.702613115310669s
5 requests
0 failed requests
5th percentile: 3.2462947845458983
10th percentile: 3.3780303955078126
20th percentile: 3.641501617431641
30th percentile: 3.77748441696167
40th percentile: 3.7859787940979004
50th percentile: 3.794473171234131
60th percentile: 3.7988104820251465
70th percentile: 3.803147792816162
80th percentile: 3.80995717048645
90th percentile: 3.819238615036011
95th percentile: 3.823879337310791
99th percentile: 3.8275919151306153
mean time: 3.6632212162017823
Pipeline stage StressChecker completed in 51.16s
Shutdown handler de-registered
function_kirum_2024-10-01 status is now deployed due to DeploymentManager action
Received healthy response to inference request in 4.723743915557861s
5 requests
0 failed requests
5th percentile: 3.6375946521759035
10th percentile: 3.6538492679595946
20th percentile: 3.6863584995269774
30th percentile: 3.759819507598877
40th percentile: 3.874232292175293
50th percentile: 3.988645076751709
60th percentile: 4.11624002456665
70th percentile: 4.243834972381592
80th percentile: 4.390854740142823
90th percentile: 4.557299327850342
95th percentile: 4.640521621704101
99th percentile: 4.707099456787109
mean time: 4.068794918060303
Pipeline stage StressChecker completed in 23.23s
Shutdown handler de-registered
function_hogob_2024-10-01 status is now deployed due to DeploymentManager action
function_hogob_2024-10-01 status is now inactive due to auto deactivation removed underperforming models
function_hogob_2024-10-01 status is now torndown due to DeploymentManager action