developer_uid: rirv938
submission_id: function_kulel_2024-12-26
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-12-26T20:05:37+00:00
num_battles: 17369
num_wins: 9012
celo_rating: 1277.22
family_friendly_score: 0.5888
family_friendly_standard_error: 0.006958657341757819
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-26
win_ratio: 0.5188554320916575
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.2730729579925537s
Received healthy response to inference request in 1.9824018478393555s
Received healthy response to inference request in 2.6965019702911377s
Received healthy response to inference request in 4.021268844604492s
Received healthy response to inference request in 2.7862231731414795s
5 requests
0 failed requests
5th percentile: 2.040536069869995
10th percentile: 2.0986702919006346
20th percentile: 2.214938735961914
30th percentile: 2.3577587604522705
40th percentile: 2.527130365371704
50th percentile: 2.6965019702911377
60th percentile: 2.7323904514312742
70th percentile: 2.768278932571411
80th percentile: 3.033232307434082
90th percentile: 3.5272505760192874
95th percentile: 3.7742597103118896
99th percentile: 3.971867017745972
mean time: 2.7518937587738037
Pipeline stage StressChecker completed in 15.26s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.63s
Shutdown handler de-registered
function_kulel_2024-12-26 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3277.10s
Shutdown handler de-registered
function_kulel_2024-12-26 status is now inactive due to auto deactivation removed underperforming models
function_kulel_2024-12-26 status is now torndown due to DeploymentManager action
function_kulel_2024-12-26 status is now torndown due to DeploymentManager action
function_kulel_2024-12-26 status is now torndown due to DeploymentManager action
ChatRequest
Generation Params
Prompt Formatter
Chat History
ChatMessage 1