developer_uid: chai_backend_admin
submission_id: function_pebom_2024-12-04
model_name: retune_with_base
model_group:
status: inactive
timestamp: 2024-12-04T20:31:28+00:00
num_battles: 10956
num_wins: 5460
celo_rating: 1259.68
family_friendly_score: 0.585
family_friendly_standard_error: 0.00696814178960216
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-04
win_ratio: 0.49835706462212487
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.330690622329712s
Received healthy response to inference request in 3.1593523025512695s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 4.429531574249268s
Received healthy response to inference request in 3.7632696628570557s
Received healthy response to inference request in 2.224330186843872s
5 requests
0 failed requests
5th percentile: 2.4113346099853517
10th percentile: 2.5983390331268312
20th percentile: 2.97234787940979
30th percentile: 3.193619966506958
40th percentile: 3.262155294418335
50th percentile: 3.330690622329712
60th percentile: 3.5037222385406492
70th percentile: 3.676753854751587
80th percentile: 3.896522045135498
90th percentile: 4.163026809692383
95th percentile: 4.296279191970825
99th percentile: 4.402881097793579
mean time: 3.3814348697662355
Pipeline stage StressChecker completed in 18.01s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.43s
Shutdown handler de-registered
function_pebom_2024-12-04 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2957.79s
Shutdown handler de-registered
function_pebom_2024-12-04 status is now inactive due to auto deactivation removed underperforming models