developer_uid: chai_backend_admin
submission_id: function_pekit_2024-09-25
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-09-25T23:06:44+00:00
num_battles: 3183
num_wins: 1641
celo_rating: 1264.16
family_friendly_score: 0.0
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-09-25
win_ratio: 0.5155513666352498
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 50, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>', '<|user|>', '###'], 'max_input_tokens': 512, 'best_of': 4, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.7158291339874268s
Received healthy response to inference request in 3.9065804481506348s
Received healthy response to inference request in 3.4289603233337402s
Received healthy response to inference request in 3.2936758995056152s
Received healthy response to inference request in 4.584676027297974s
5 requests
0 failed requests
5th percentile: 3.3207327842712404
10th percentile: 3.347789669036865
20th percentile: 3.401903438568115
30th percentile: 3.4863340854644775
40th percentile: 3.601081609725952
50th percentile: 3.7158291339874268
60th percentile: 3.79212965965271
70th percentile: 3.868430185317993
80th percentile: 4.042199563980103
90th percentile: 4.313437795639038
95th percentile: 4.449056911468506
99th percentile: 4.55755220413208
mean time: 3.785944366455078
Pipeline stage StressChecker completed in 21.28s
Shutdown handler de-registered
function_pekit_2024-09-25 status is now deployed due to DeploymentManager action
function_pekit_2024-09-25 status is now inactive due to auto deactivation removed underperforming models
run pipeline %s
Waiting for inference service blend-rofur-2024-10-03 to be ready
function_pekit_2024-09-25 status is now torndown due to DeploymentManager action