submission_id: function_fokit_2024-10-14
developer_uid: chai_backend_admin
celo_rating: 1239.47
display_name: retune_with_base
family_friendly_score: 0.6094466743119267
family_friendly_standard_error: 0.004739113050649351
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 11150
num_wins: 6206
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-10-14T17:35:39+00:00
us_pacific_date: 2024-10-14
win_ratio: 0.556591928251121
Download Preference Data
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.378316879272461s
Received healthy response to inference request in 1.677661418914795s
Received healthy response to inference request in 2.024893045425415s
Received healthy response to inference request in 1.6569137573242188s
Received healthy response to inference request in 1.8078985214233398s
5 requests
0 failed requests
5th percentile: 1.4340362548828125
10th percentile: 1.489755630493164
20th percentile: 1.6011943817138672
30th percentile: 1.661063289642334
40th percentile: 1.6693623542785645
50th percentile: 1.677661418914795
60th percentile: 1.7297562599182128
70th percentile: 1.781851100921631
80th percentile: 1.851297426223755
90th percentile: 1.9380952358245849
95th percentile: 1.981494140625
99th percentile: 2.016213264465332
mean time: 1.709136724472046
Pipeline stage StressChecker completed in 10.47s
Shutdown handler de-registered
function_fokit_2024-10-14 status is now deployed due to DeploymentManager action
function_fokit_2024-10-14 status is now inactive due to auto deactivation removed underperforming models
function_fokit_2024-10-14 status is now torndown due to DeploymentManager action