developer_uid: chai_backend_admin
submission_id: function_memum_2024-12-13
model_name: retune_with_base
model_group:
status: inactive
timestamp: 2024-12-13T01:02:47+00:00
num_battles: 7425
num_wins: 3756
celo_rating: 1256.96
family_friendly_score: 0.5860000000000001
family_friendly_standard_error: 0.006965687331484238
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-12
win_ratio: 0.5058585858585859
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.309302806854248s
Received healthy response to inference request in 1.822782278060913s
Received healthy response to inference request in 2.6669883728027344s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 3.027736186981201s
Received healthy response to inference request in 3.2165329456329346s
5 requests
0 failed requests
5th percentile: 1.92008638381958
10th percentile: 2.017390489578247
20th percentile: 2.211998701095581
30th percentile: 2.3808399200439454
40th percentile: 2.5239141464233397
50th percentile: 2.6669883728027344
60th percentile: 2.811287498474121
70th percentile: 2.9555866241455075
80th percentile: 3.0654955387115477
90th percentile: 3.141014242172241
95th percentile: 3.178773593902588
99th percentile: 3.2089810752868653
mean time: 2.6086685180664064
Pipeline stage StressChecker completed in 14.26s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.23s
Shutdown handler de-registered
function_memum_2024-12-13 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2861.00s
Shutdown handler de-registered
function_memum_2024-12-13 status is now inactive due to auto deactivation removed underperforming models