developer_uid: rirv938
submission_id: function_rufor_2024-12-31
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-12-31T17:08:25+00:00
num_battles: 11696
num_wins: 6157
celo_rating: 1287.02
family_friendly_score: 0.5886
family_friendly_standard_error: 0.006959167191553886
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-31
win_ratio: 0.5264192886456909
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.2980873584747314s
Received healthy response to inference request in 1.7207610607147217s
Received healthy response to inference request in 2.161010503768921s
Received healthy response to inference request in 1.686157464981079s
Received healthy response to inference request in 1.6603152751922607s
5 requests
0 failed requests
5th percentile: 1.6654837131500244
10th percentile: 1.670652151107788
20th percentile: 1.6809890270233154
30th percentile: 1.6930781841278075
40th percentile: 1.7069196224212646
50th percentile: 1.7207610607147217
60th percentile: 1.8968608379364014
70th percentile: 2.072960615158081
80th percentile: 2.188425874710083
90th percentile: 2.243256616592407
95th percentile: 2.2706719875335692
99th percentile: 2.292604284286499
mean time: 1.9052663326263428
Pipeline stage StressChecker completed in 10.66s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.71s
Shutdown handler de-registered
function_rufor_2024-12-31 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2586.92s
Shutdown handler de-registered
function_rufor_2024-12-31 status is now inactive due to auto deactivation removed underperforming models
function_rufor_2024-12-31 status is now torndown due to DeploymentManager action
function_rufor_2024-12-31 status is now torndown due to DeploymentManager action
function_rufor_2024-12-31 status is now torndown due to DeploymentManager action
ChatRequest
Generation Params
Prompt Formatter
Chat History
ChatMessage 1