submission_id: function_mojen_2024-10-01
developer_uid: chai_backend_admin
celo_rating: 1276.27
display_name: retune_with_base
family_friendly_score: 0.5847252401025596
family_friendly_standard_error: 0.0022617933131610602
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.75, 'top_p': 1.0, 'min_p': 0.1, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '\n\n', '\nYou:', '[/INST]', '<|im_end|>', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 51433
num_wins: 26125
ranking_group: single
status: inactive
submission_type: function
timestamp: 2024-10-01T02:52:09+00:00
us_pacific_date: 2024-09-30
win_ratio: 0.5079423716291097
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.43135666847229s
Received healthy response to inference request in 3.6488037109375s
Received healthy response to inference request in 2.706852674484253s
Received healthy response to inference request in 3.138986587524414s
Received healthy response to inference request in 3.7430949211120605s
5 requests
0 failed requests
5th percentile: 2.793279457092285
10th percentile: 2.8797062397003175
20th percentile: 3.052559804916382
30th percentile: 3.1974606037139894
40th percentile: 3.3144086360931397
50th percentile: 3.43135666847229
60th percentile: 3.518335485458374
70th percentile: 3.605314302444458
80th percentile: 3.667661952972412
90th percentile: 3.7053784370422362
95th percentile: 3.7242366790771486
99th percentile: 3.7393232727050782
mean time: 3.3338189125061035
Pipeline stage StressChecker completed in 18.56s
Shutdown handler de-registered
function_mojen_2024-10-01 status is now deployed due to DeploymentManager action
function_mojen_2024-10-01 status is now inactive due to auto deactivation removed underperforming models
function_mojen_2024-10-01 status is now deployed due to admin request
function_mojen_2024-10-01 status is now inactive due to auto deactivation removed underperforming models