function_mahan_2024-11-06

submission_id: function_mahan_2024-11-06

developer_uid: chai_backend_admin

celo_rating: 1214.45

display_name: retune_with_base

family_friendly_score: 0.6095999999999999

family_friendly_standard_error: 0.006899099071617974

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

is_internal_developer: True

model_group:

model_name: retune_with_base

num_battles: 26744

num_wins: 13176

ranking_group: single

status: inactive

submission_type: function

timestamp: 2024-11-06T22:18:14+00:00

us_pacific_date: 2024-11-06

win_ratio: 0.4926712533652408

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.222839593887329s
Received healthy response to inference request in 3.220491409301758s
Received healthy response to inference request in 3.374892234802246s
Received healthy response to inference request in 4.736623287200928s
Received healthy response to inference request in 3.7807366847991943s
5 requests
0 failed requests
5th percentile: 3.2513715744018556
10th percentile: 3.282251739501953
20th percentile: 3.3440120697021483
30th percentile: 3.4560611248016357
40th percentile: 3.618398904800415
50th percentile: 3.7807366847991943
60th percentile: 3.957577848434448
70th percentile: 4.134419012069702
80th percentile: 4.325596332550049
90th percentile: 4.531109809875488
95th percentile: 4.633866548538208
99th percentile: 4.716071939468383
mean time: 3.867116641998291
%s, retrying in %s seconds...
Received healthy response to inference request in 3.389207363128662s
Received healthy response to inference request in 3.042475700378418s
Received healthy response to inference request in 5.059013605117798s
Received healthy response to inference request in 2.263296604156494s
Received healthy response to inference request in 3.0553271770477295s
5 requests
0 failed requests
5th percentile: 2.419132423400879
10th percentile: 2.5749682426452636
20th percentile: 2.886639881134033
30th percentile: 3.04504599571228
40th percentile: 3.050186586380005
50th percentile: 3.0553271770477295
60th percentile: 3.1888792514801025
70th percentile: 3.3224313259124756
80th percentile: 3.7231686115264897
90th percentile: 4.3910911083221436
95th percentile: 4.725052356719971
99th percentile: 4.992221355438232
mean time: 3.3618640899658203
Pipeline stage StressChecker completed in 38.72s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 5.96s
Shutdown handler de-registered
function_mahan_2024-11-06 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 4507.10s
Shutdown handler de-registered
function_mahan_2024-11-06 status is now inactive due to auto deactivation removed underperforming models