submission_id: function_debil_2024-10-20
developer_uid: chai_backend_admin
celo_rating: 1225.12
display_name: retune_with_base
family_friendly_score: 0.5671078041576736
family_friendly_standard_error: 0.005255376864258002
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 9349
num_wins: 4633
ranking_group: single
status: inactive
submission_type: function
timestamp: 2024-10-20T05:03:35+00:00
us_pacific_date: 2024-10-19
win_ratio: 0.49556102256925877
Download Preference Data
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.044827461242676s
Received healthy response to inference request in 2.6545307636260986s
Received healthy response to inference request in 5.1122145652771s
Received healthy response to inference request in 1.8931949138641357s
Received healthy response to inference request in 3.705482006072998s
5 requests
0 failed requests
5th percentile: 2.0454620838165285
10th percentile: 2.197729253768921
20th percentile: 2.502263593673706
30th percentile: 2.732590103149414
40th percentile: 2.888708782196045
50th percentile: 3.044827461242676
60th percentile: 3.3090892791748048
70th percentile: 3.5733510971069333
80th percentile: 3.9868285179138185
90th percentile: 4.549521541595459
95th percentile: 4.830868053436279
99th percentile: 5.055945262908936
mean time: 3.2820499420166014
Pipeline stage StressChecker completed in 17.63s
Shutdown handler de-registered
function_debil_2024-10-20 status is now deployed due to DeploymentManager action
function_debil_2024-10-20 status is now inactive due to auto deactivation removed underperforming models