developer_uid: chai_backend_admin
submission_id: function_regun_2024-11-14
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-11-14T21:38:02+00:00
num_battles: 5881
num_wins: 2979
celo_rating: 1260.72
family_friendly_score: 0.5760000000000001
family_friendly_standard_error: 0.0069889054937092975
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-11-14
win_ratio: 0.5065465056963101
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.665616273880005s
Received healthy response to inference request in 3.134822130203247s
Received healthy response to inference request in 2.5135114192962646s
Received healthy response to inference request in 2.2503011226654053s
Received healthy response to inference request in 2.4414474964141846s
5 requests
0 failed requests
5th percentile: 2.288530397415161
10th percentile: 2.326759672164917
20th percentile: 2.403218221664429
30th percentile: 2.4558602809906005
40th percentile: 2.484685850143433
50th percentile: 2.5135114192962646
60th percentile: 2.5743533611297607
70th percentile: 2.6351953029632567
80th percentile: 2.7594574451446534
90th percentile: 2.94713978767395
95th percentile: 3.0409809589385985
99th percentile: 3.1160538959503175
mean time: 2.601139688491821
Pipeline stage StressChecker completed in 14.19s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 6.02s
Shutdown handler de-registered
function_regun_2024-11-14 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2780.91s
Shutdown handler de-registered
function_regun_2024-11-14 status is now inactive due to auto deactivation removed underperforming models
function_regun_2024-11-14 status is now torndown due to DeploymentManager action