developer_uid: rirv938
submission_id: function_lasaf_2024-12-31
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-12-31T17:11:31+00:00
num_battles: 18656
num_wins: 9739
celo_rating: 1282.43
family_friendly_score: 0.6022000000000001
family_friendly_standard_error: 0.006921779539973806
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-31
win_ratio: 0.5220304459691252
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.5275487899780273s
Received healthy response to inference request in 2.0899507999420166s
Received healthy response to inference request in 2.2871456146240234s
Received healthy response to inference request in 1.5280451774597168s
Received healthy response to inference request in 2.097790002822876s
5 requests
0 failed requests
5th percentile: 1.5276480674743653
10th percentile: 1.527747344970703
20th percentile: 1.5279458999633788
30th percentile: 1.6404263019561767
40th percentile: 1.8651885509490966
50th percentile: 2.0899507999420166
60th percentile: 2.0930864810943604
70th percentile: 2.096222162246704
80th percentile: 2.1356611251831055
90th percentile: 2.2114033699035645
95th percentile: 2.249274492263794
99th percentile: 2.2795713901519776
mean time: 1.9060960769653321
Pipeline stage StressChecker completed in 10.68s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.63s
Shutdown handler de-registered
function_lasaf_2024-12-31 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2577.43s
Shutdown handler de-registered
function_lasaf_2024-12-31 status is now inactive due to auto deactivation removed underperforming models
function_lasaf_2024-12-31 status is now torndown due to DeploymentManager action
function_lasaf_2024-12-31 status is now torndown due to DeploymentManager action
function_lasaf_2024-12-31 status is now torndown due to DeploymentManager action
ChatRequest
Generation Params
Prompt Formatter
Chat History
ChatMessage 1