developer_uid: chai_backend_admin
submission_id: function_jemur_2024-11-27
model_name: retune_with_base
model_group:
status: inactive
timestamp: 2024-11-27T23:55:15+00:00
num_battles: 15557
num_wins: 7926
celo_rating: 1271.65
family_friendly_score: 0.5598000000000001
family_friendly_standard_error: 0.007020312813543283
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-11-27
win_ratio: 0.5094812624542007
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.2846662998199463s
Received healthy response to inference request in 2.9263694286346436s
Received healthy response to inference request in 2.5140604972839355s
Received healthy response to inference request in 3.3757312297821045s
Received healthy response to inference request in 2.7397515773773193s
5 requests
0 failed requests
5th percentile: 2.3305451393127443
10th percentile: 2.376423978805542
20th percentile: 2.4681816577911375
30th percentile: 2.5591987133026124
40th percentile: 2.6494751453399656
50th percentile: 2.7397515773773193
60th percentile: 2.814398717880249
70th percentile: 2.8890458583831786
80th percentile: 3.0162417888641357
90th percentile: 3.19598650932312
95th percentile: 3.2858588695526123
99th percentile: 3.357756757736206
mean time: 2.7681158065795897
Pipeline stage StressChecker completed in 14.92s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.10s
Shutdown handler de-registered
function_jemur_2024-11-27 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3829.69s
Shutdown handler de-registered
function_jemur_2024-11-27 status is now inactive due to auto deactivation removed underperforming models