developer_uid: chai_backend_admin
submission_id: function_fisit_2024-11-19
model_name: retune_with_base
model_group:
status: inactive
timestamp: 2024-11-19T17:34:51+00:00
num_battles: 7575
num_wins: 4026
celo_rating: 1271.75
family_friendly_score: 0.5746
family_friendly_standard_error: 0.006991921624274688
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-11-19
win_ratio: 0.5314851485148515
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 5.534038305282593s
Received healthy response to inference request in 3.7268407344818115s
Received healthy response to inference request in 3.306162118911743s
Received healthy response to inference request in 3.630589723587036s
Received healthy response to inference request in 3.3553240299224854s
5 requests
0 failed requests
5th percentile: 3.3159945011138916
10th percentile: 3.32582688331604
20th percentile: 3.345491647720337
30th percentile: 3.4103771686553954
40th percentile: 3.520483446121216
50th percentile: 3.630589723587036
60th percentile: 3.6690901279449464
70th percentile: 3.7075905323028566
80th percentile: 4.0882802486419685
90th percentile: 4.811159276962281
95th percentile: 5.172598791122436
99th percentile: 5.461750402450561
mean time: 3.910590982437134
%s, retrying in %s seconds...
Received healthy response to inference request in 4.285007953643799s
Received healthy response to inference request in 3.272000789642334s
Received healthy response to inference request in 3.2526602745056152s
Received healthy response to inference request in 2.621483087539673s
Received healthy response to inference request in 2.46178936958313s
5 requests
0 failed requests
5th percentile: 2.4937281131744387
10th percentile: 2.525666856765747
20th percentile: 2.589544343948364
30th percentile: 2.7477185249328615
40th percentile: 3.0001893997192384
50th percentile: 3.2526602745056152
60th percentile: 3.2603964805603027
70th percentile: 3.2681326866149902
80th percentile: 3.474602222442627
90th percentile: 3.879805088043213
95th percentile: 4.082406520843506
99th percentile: 4.244487667083741
mean time: 3.17858829498291
Pipeline stage StressChecker completed in 37.83s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.57s
Shutdown handler de-registered
function_fisit_2024-11-19 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3139.80s
Shutdown handler de-registered
function_fisit_2024-11-19 status is now inactive due to auto deactivation removed underperforming models