developer_uid: chai_backend_admin
submission_id: function_figeb_2024-11-27
model_name: retune_with_base
model_group:
status: inactive
timestamp: 2024-11-27T19:44:50+00:00
num_battles: 11577
num_wins: 5795
celo_rating: 1260.31
family_friendly_score: 0.5622
family_friendly_standard_error: 0.007016140819567407
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-11-27
win_ratio: 0.5005614580634016
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.391327142715454s
Received healthy response to inference request in 3.314140558242798s
Received healthy response to inference request in 3.1586556434631348s
Received healthy response to inference request in 3.103656768798828s
Received healthy response to inference request in 2.2549638748168945s
5 requests
0 failed requests
5th percentile: 2.424702453613281
10th percentile: 2.594441032409668
20th percentile: 2.9339181900024416
30th percentile: 3.1146565437316895
40th percentile: 3.136656093597412
50th percentile: 3.1586556434631348
60th percentile: 3.220849609375
70th percentile: 3.2830435752868654
80th percentile: 3.3295778751373293
90th percentile: 3.3604525089263917
95th percentile: 3.3758898258209227
99th percentile: 3.388239679336548
mean time: 3.0445487976074217
Pipeline stage StressChecker completed in 16.39s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.41s
Shutdown handler de-registered
function_figeb_2024-11-27 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3328.94s
Shutdown handler de-registered
function_figeb_2024-11-27 status is now inactive due to auto deactivation removed underperforming models