developer_uid: rirv938
submission_id: function_nahat_2025-02-27
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2025-02-27T21:02:15+00:00
num_battles: 6362
num_wins: 3259
celo_rating: 1293.15
family_friendly_score: 0.5352
family_friendly_standard_error: 0.007053523374881521
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-02-27
win_ratio: 0.5122602955045583
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.872605085372925s
Received healthy response to inference request in 5.992587089538574s
Received healthy response to inference request in 3.4708478450775146s
Received healthy response to inference request in 2.632309675216675s
Received healthy response to inference request in 3.3047142028808594s
5 requests
0 failed requests
5th percentile: 2.766790580749512
10th percentile: 2.9012714862823485
20th percentile: 3.1702332973480223
30th percentile: 3.3379409313201904
40th percentile: 3.4043943881988525
50th percentile: 3.4708478450775146
60th percentile: 3.631550741195679
70th percentile: 3.7922536373138427
80th percentile: 4.296601486206055
90th percentile: 5.144594287872315
95th percentile: 5.568590688705444
99th percentile: 5.907787809371948
mean time: 3.8546127796173097
%s, retrying in %s seconds...
Received healthy response to inference request in 2.6071975231170654s
Received healthy response to inference request in 2.9686167240142822s
Received healthy response to inference request in 2.4459848403930664s
Received healthy response to inference request in 2.5210635662078857s
Received healthy response to inference request in 2.5815064907073975s
5 requests
0 failed requests
5th percentile: 2.46100058555603
10th percentile: 2.476016330718994
20th percentile: 2.506047821044922
30th percentile: 2.533152151107788
40th percentile: 2.5573293209075927
50th percentile: 2.5815064907073975
60th percentile: 2.5917829036712647
70th percentile: 2.602059316635132
80th percentile: 2.679481363296509
90th percentile: 2.8240490436553953
95th percentile: 2.896332883834839
99th percentile: 2.9541599559783935
mean time: 2.6248738288879396
Pipeline stage StressChecker completed in 34.95s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.66s
Shutdown handler de-registered
function_nahat_2025-02-27 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3010.69s
Shutdown handler de-registered
function_nahat_2025-02-27 status is now inactive due to auto deactivation removed underperforming models
function_nahat_2025-02-27 status is now torndown due to DeploymentManager action
ChatRequest
Generation Params
Prompt Formatter
Chat History
ChatMessage 1