submission_id: function_neses_2024-11-12
developer_uid: chai_backend_admin
celo_rating: 1282.25
display_name: retune_with_base
family_friendly_score: 0.5864
family_friendly_standard_error: 0.006964697265495466
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 13053
num_wins: 7200
ranking_group: single
status: inactive
submission_type: function
timestamp: 2024-11-12T13:53:19+00:00
us_pacific_date: 2024-11-12
win_ratio: 0.5515973339462192
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 5.591917037963867s
Received healthy response to inference request in 4.997681140899658s
Received healthy response to inference request in 3.085822105407715s
Received healthy response to inference request in 3.7598602771759033s
Received healthy response to inference request in 4.928382635116577s
5 requests
0 failed requests
5th percentile: 3.2206297397613524
10th percentile: 3.3554373741149903
20th percentile: 3.625052642822266
30th percentile: 3.993564748764038
40th percentile: 4.460973691940308
50th percentile: 4.928382635116577
60th percentile: 4.95610203742981
70th percentile: 4.983821439743042
80th percentile: 5.1165283203125
90th percentile: 5.354222679138184
95th percentile: 5.473069858551026
99th percentile: 5.568147602081299
mean time: 4.472732639312744
%s, retrying in %s seconds...
Received healthy response to inference request in 5.599207162857056s
Received healthy response to inference request in 2.094787836074829s
Received healthy response to inference request in 3.4177181720733643s
Received healthy response to inference request in 3.5105364322662354s
Received healthy response to inference request in 2.855358600616455s
5 requests
0 failed requests
5th percentile: 2.2469019889831543
10th percentile: 2.3990161418914795
20th percentile: 2.70324444770813
30th percentile: 2.967830514907837
40th percentile: 3.1927743434906004
50th percentile: 3.4177181720733643
60th percentile: 3.4548454761505125
70th percentile: 3.491972780227661
80th percentile: 3.9282705783844
90th percentile: 4.7637388706207275
95th percentile: 5.181473016738892
99th percentile: 5.515660333633423
mean time: 3.495521640777588
Pipeline stage StressChecker completed in 42.74s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.23s
Shutdown handler de-registered
function_neses_2024-11-12 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 4121.04s
Shutdown handler de-registered
function_neses_2024-11-12 status is now inactive due to auto deactivation removed underperforming models