developer_uid: chai_backend_admin
submission_id: function_nidat_2024-12-13
model_name: retune_with_base
model_group:
status: inactive
timestamp: 2024-12-13T00:52:43+00:00
num_battles: 8986
num_wins: 4402
celo_rating: 1246.08
family_friendly_score: 0.5853999999999999
family_friendly_standard_error: 0.006967163554847841
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-12
win_ratio: 0.4898731359893167
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.777613878250122s
Received healthy response to inference request in 2.7001144886016846s
Received healthy response to inference request in 2.7398898601531982s
Received healthy response to inference request in 2.3918585777282715s
Received healthy response to inference request in 2.504183292388916s
5 requests
0 failed requests
5th percentile: 2.4143235206604006
10th percentile: 2.436788463592529
20th percentile: 2.481718349456787
30th percentile: 2.5433695316314697
40th percentile: 2.621742010116577
50th percentile: 2.7001144886016846
60th percentile: 2.71602463722229
70th percentile: 2.7319347858428955
80th percentile: 2.747434663772583
90th percentile: 2.7625242710113525
95th percentile: 2.7700690746307375
99th percentile: 2.7761049175262453
mean time: 2.6227320194244386
Pipeline stage StressChecker completed in 14.17s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.22s
Shutdown handler de-registered
function_nidat_2024-12-13 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2804.23s
Shutdown handler de-registered
function_nidat_2024-12-13 status is now inactive due to auto deactivation removed underperforming models