submission_id: function_fajat_2024-10-01
developer_uid: chai_backend_admin
celo_rating: 1257.96
display_name: retune_with_base
family_friendly_score: 0.580010775862069
family_friendly_standard_error: 0.008081803388811884
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 3820
num_wins: 1908
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-10-01T20:49:11+00:00
us_pacific_date: 2024-10-01
win_ratio: 0.49947643979057593
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.113612413406372s
Received healthy response to inference request in 3.1893396377563477s
Received healthy response to inference request in 3.4861958026885986s
Received healthy response to inference request in 3.577282190322876s
Received healthy response to inference request in 2.5103795528411865s
5 requests
0 failed requests
5th percentile: 2.6461715698242188
10th percentile: 2.781963586807251
20th percentile: 3.0535476207733154
30th percentile: 3.248710870742798
40th percentile: 3.3674533367156982
50th percentile: 3.4861958026885986
60th percentile: 3.5226303577423095
70th percentile: 3.5590649127960203
80th percentile: 3.6845482349395753
90th percentile: 3.8990803241729735
95th percentile: 4.006346368789673
99th percentile: 4.092159204483032
mean time: 3.375361919403076
Pipeline stage StressChecker completed in 19.23s
Shutdown handler de-registered
function_fajat_2024-10-01 status is now deployed due to DeploymentManager action
function_fajat_2024-10-01 status is now inactive due to auto deactivation removed underperforming models
function_fajat_2024-10-01 status is now torndown due to DeploymentManager action