submission_id: function_regun_2024-11-14
developer_uid: chai_backend_admin
celo_rating: 1260.72
display_name: retune_with_base
family_friendly_score: 0.5760000000000001
family_friendly_standard_error: 0.0069889054937092975
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 5881
num_wins: 2979
ranking_group: single
status: inactive
submission_type: function
timestamp: 2024-11-14T21:38:02+00:00
us_pacific_date: 2024-11-14
win_ratio: 0.5065465056963101
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.665616273880005s
Received healthy response to inference request in 3.134822130203247s
Received healthy response to inference request in 2.5135114192962646s
Received healthy response to inference request in 2.2503011226654053s
Received healthy response to inference request in 2.4414474964141846s
5 requests
0 failed requests
5th percentile: 2.288530397415161
10th percentile: 2.326759672164917
20th percentile: 2.403218221664429
30th percentile: 2.4558602809906005
40th percentile: 2.484685850143433
50th percentile: 2.5135114192962646
60th percentile: 2.5743533611297607
70th percentile: 2.6351953029632567
80th percentile: 2.7594574451446534
90th percentile: 2.94713978767395
95th percentile: 3.0409809589385985
99th percentile: 3.1160538959503175
mean time: 2.601139688491821
Pipeline stage StressChecker completed in 14.19s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 6.02s
Shutdown handler de-registered
function_regun_2024-11-14 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2780.91s
Shutdown handler de-registered
function_regun_2024-11-14 status is now inactive due to auto deactivation removed underperforming models