developer_uid: chai_backend_admin
submission_id: function_ligar_2024-12-07
model_name: retune_with_base
model_group:
status: inactive
timestamp: 2024-12-07T02:46:05+00:00
num_battles: 9683
num_wins: 4805
celo_rating: 1263.44
family_friendly_score: 0.5618000000000001
family_friendly_standard_error: 0.007016847725296595
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-06
win_ratio: 0.49623050707425387
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.464244842529297s
Received healthy response to inference request in 2.191810131072998s
Received healthy response to inference request in 2.3176379203796387s
Received healthy response to inference request in 2.429654836654663s
Received healthy response to inference request in 2.319249391555786s
5 requests
0 failed requests
5th percentile: 2.216975688934326
10th percentile: 2.2421412467956543
20th percentile: 2.2924723625183105
30th percentile: 2.3179602146148683
40th percentile: 2.3186048030853272
50th percentile: 2.319249391555786
60th percentile: 2.363411569595337
70th percentile: 2.4075737476348875
80th percentile: 2.4365728378295897
90th percentile: 2.4504088401794433
95th percentile: 2.4573268413543703
99th percentile: 2.4628612422943115
mean time: 2.3445194244384764
Pipeline stage StressChecker completed in 12.98s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.35s
Shutdown handler de-registered
function_ligar_2024-12-07 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2591.08s
Shutdown handler de-registered
function_ligar_2024-12-07 status is now inactive due to auto deactivation removed underperforming models