submission_id: function_rodut_2024-11-12
developer_uid: chai_backend_admin
celo_rating: 1249.22
display_name: retune_with_base
family_friendly_score: 0.5596
family_friendly_standard_error: 0.0070206529610856
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 15943
num_wins: 7890
ranking_group: single
status: inactive
submission_type: function
timestamp: 2024-11-12T13:27:55+00:00
us_pacific_date: 2024-11-12
win_ratio: 0.49488803863764663
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.2049391269683838s
Received healthy response to inference request in 3.010911226272583s
Received healthy response to inference request in 2.704704523086548s
Received healthy response to inference request in 2.089848518371582s
Received healthy response to inference request in 1.3147175312042236s
5 requests
0 failed requests
5th percentile: 1.2268948078155517
10th percentile: 1.2488504886627196
20th percentile: 1.2927618503570557
30th percentile: 1.4697437286376953
40th percentile: 1.7797961235046387
50th percentile: 2.089848518371582
60th percentile: 2.335790920257568
70th percentile: 2.5817333221435548
80th percentile: 2.765945863723755
90th percentile: 2.888428544998169
95th percentile: 2.949669885635376
99th percentile: 2.9986629581451414
mean time: 2.065024185180664
Pipeline stage StressChecker completed in 11.57s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.35s
Shutdown handler de-registered
function_rodut_2024-11-12 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3355.77s
Shutdown handler de-registered
function_rodut_2024-11-12 status is now inactive due to auto deactivation removed underperforming models