developer_uid: chai_backend_admin
submission_id: function_jaseb_2024-11-23
model_name: retune_with_base
model_group:
status: inactive
timestamp: 2024-11-23T00:24:14+00:00
num_battles: 16874
num_wins: 9244
celo_rating: 1300.65
family_friendly_score: 0.5828
family_friendly_standard_error: 0.006973437602789603
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-11-22
win_ratio: 0.5478250562996325
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.7467947006225586s
Received healthy response to inference request in 3.2885324954986572s
Received healthy response to inference request in 3.4430160522460938s
Received healthy response to inference request in 3.298258066177368s
Received healthy response to inference request in 3.042402744293213s
5 requests
0 failed requests
5th percentile: 2.8059163093566895
10th percentile: 2.8650379180908203
20th percentile: 2.983281135559082
30th percentile: 3.0916286945343017
40th percentile: 3.1900805950164797
50th percentile: 3.2885324954986572
60th percentile: 3.292422723770142
70th percentile: 3.296312952041626
80th percentile: 3.3272096633911135
90th percentile: 3.3851128578186036
95th percentile: 3.4140644550323485
99th percentile: 3.437225732803345
mean time: 3.163800811767578
Pipeline stage StressChecker completed in 17.08s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.75s
Shutdown handler de-registered
function_jaseb_2024-11-23 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3754.58s
Shutdown handler de-registered
function_jaseb_2024-11-23 status is now inactive due to auto deactivation removed underperforming models