submission_id: function_libol_2024-11-16
developer_uid: chai_backend_admin
celo_rating: 1253.7
display_name: retune_with_base
family_friendly_score: 0.5738
family_friendly_standard_error: 0.006993619377689924
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 17748
num_wins: 8964
ranking_group: single
status: inactive
submission_type: function
timestamp: 2024-11-16T19:27:49+00:00
us_pacific_date: 2024-11-16
win_ratio: 0.5050709939148073
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 5.223238706588745s
Received healthy response to inference request in 2.9130070209503174s
Received healthy response to inference request in 3.3509137630462646s
Received healthy response to inference request in 2.4235641956329346s
Received healthy response to inference request in 2.777656316757202s
5 requests
0 failed requests
5th percentile: 2.494382619857788
10th percentile: 2.5652010440826416
20th percentile: 2.7068378925323486
30th percentile: 2.8047264575958253
40th percentile: 2.858866739273071
50th percentile: 2.9130070209503174
60th percentile: 3.088169717788696
70th percentile: 3.263332414627075
80th percentile: 3.725378751754761
90th percentile: 4.474308729171753
95th percentile: 4.848773717880249
99th percentile: 5.148345708847046
mean time: 3.337676000595093
Pipeline stage StressChecker completed in 17.94s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.82s
Shutdown handler de-registered
function_libol_2024-11-16 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3129.28s
Shutdown handler de-registered
function_libol_2024-11-16 status is now inactive due to auto deactivation removed underperforming models