developer_uid: rirv938
submission_id: function_norur_2024-12-31
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-12-31T17:03:28+00:00
num_battles: 9049
num_wins: 4766
celo_rating: 1287.85
family_friendly_score: 0.593
family_friendly_standard_error: 0.00694767587039004
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-31
win_ratio: 0.5266880318267212
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.670794725418091s
Received healthy response to inference request in 5.760983943939209s
Received healthy response to inference request in 3.0559136867523193s
Received healthy response to inference request in 2.0288245677948s
Received healthy response to inference request in 6.648099899291992s
5 requests
0 failed requests
5th percentile: 2.234242391586304
10th percentile: 2.4396602153778075
20th percentile: 2.8504958629608153
30th percentile: 3.1788898944854735
40th percentile: 3.4248423099517824
50th percentile: 3.670794725418091
60th percentile: 4.5068704128265376
70th percentile: 5.342946100234985
80th percentile: 5.938407135009766
90th percentile: 6.2932535171508786
95th percentile: 6.470676708221435
99th percentile: 6.612615261077881
mean time: 4.232923364639282
%s, retrying in %s seconds...
Received healthy response to inference request in 2.405486822128296s
Received healthy response to inference request in 3.012599468231201s
Received healthy response to inference request in 4.088671684265137s
Received healthy response to inference request in 2.600984573364258s
Received healthy response to inference request in 3.4124813079833984s
5 requests
0 failed requests
5th percentile: 2.4445863723754884
10th percentile: 2.483685922622681
20th percentile: 2.5618850231170653
30th percentile: 2.6833075523376464
40th percentile: 2.847953510284424
50th percentile: 3.012599468231201
60th percentile: 3.17255220413208
70th percentile: 3.3325049400329587
80th percentile: 3.5477193832397464
90th percentile: 3.8181955337524416
95th percentile: 3.9534336090087887
99th percentile: 4.061624069213867
mean time: 3.104044771194458
Pipeline stage StressChecker completed in 38.93s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.68s
Shutdown handler de-registered
function_norur_2024-12-31 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2896.43s
Shutdown handler de-registered
function_norur_2024-12-31 status is now inactive due to auto deactivation removed underperforming models
run pipeline %s
admin requested tearing down of function_norur_2024-12-31
run pipeline stage %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Running pipeline stage MKMLDeleter
run pipeline %s
Pipeline stage %s skipped, reason=%s
Shutdown handler de-registered
Pipeline stage MKMLDeleter completed in 0.29s
function_norur_2024-12-31 status is now torndown due to DeploymentManager action
function_norur_2024-12-31 status is now torndown due to DeploymentManager action
function_norur_2024-12-31 status is now torndown due to DeploymentManager action
ChatRequest
Generation Params
Prompt Formatter
Chat History
ChatMessage 1