developer_uid: chai_backend_admin
submission_id: function_labum_2024-11-16
model_name: retune_with_base
model_group:
status: inactive
timestamp: 2024-11-16T19:23:20+00:00
num_battles: 15075
num_wins: 7662
celo_rating: 1255.16
family_friendly_score: 0.5784
family_friendly_standard_error: 0.006983601363193635
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-11-16
win_ratio: 0.5082587064676617
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.860556125640869s
Received healthy response to inference request in 2.333702802658081s
Received healthy response to inference request in 2.439504384994507s
Received healthy response to inference request in 2.855165481567383s
Received healthy response to inference request in 2.6419622898101807s
5 requests
0 failed requests
5th percentile: 2.3548631191253664
10th percentile: 2.3760234355926513
20th percentile: 2.4183440685272215
30th percentile: 2.4799959659576416
40th percentile: 2.560979127883911
50th percentile: 2.6419622898101807
60th percentile: 2.7272435665130614
70th percentile: 2.812524843215942
80th percentile: 3.0562436103820803
90th percentile: 3.4583998680114747
95th percentile: 3.6594779968261717
99th percentile: 3.8203404998779296
mean time: 2.826178216934204
Pipeline stage StressChecker completed in 15.37s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.44s
Shutdown handler de-registered
function_labum_2024-11-16 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3130.87s
Shutdown handler de-registered
function_labum_2024-11-16 status is now inactive due to auto deactivation removed underperforming models