developer_uid: chai_backend_admin
submission_id: function_kesor_2024-10-21
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-10-21T18:11:02+00:00
num_battles: 8310
num_wins: 4477
celo_rating: 1234.97
family_friendly_score: 0.6209246677776354
family_friendly_standard_error: 0.005465368004396082
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-10-21
win_ratio: 0.5387484957882069
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.533128261566162s
Received healthy response to inference request in 2.119783639907837s
Received healthy response to inference request in 1.6605756282806396s
Received healthy response to inference request in 1.3236656188964844s
Received healthy response to inference request in 1.1494574546813965s
5 requests
0 failed requests
5th percentile: 1.1842990875244142
10th percentile: 1.2191407203674316
20th percentile: 1.2888239860534667
30th percentile: 1.36555814743042
40th percentile: 1.449343204498291
50th percentile: 1.533128261566162
60th percentile: 1.5841072082519532
70th percentile: 1.6350861549377442
80th percentile: 1.7524172306060792
90th percentile: 1.936100435256958
95th percentile: 2.0279420375823975
99th percentile: 2.101415319442749
mean time: 1.557322120666504
Pipeline stage StressChecker completed in 9.15s
Shutdown handler de-registered
function_kesor_2024-10-21 status is now deployed due to DeploymentManager action
function_kesor_2024-10-21 status is now inactive due to auto deactivation removed underperforming models
function_kesor_2024-10-21 status is now torndown due to DeploymentManager action