developer_uid: chai_backend_admin
submission_id: function_halum_2024-10-27
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-10-27T00:28:32+00:00
num_battles: 12575
num_wins: 6627
celo_rating: 1213.75
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-10-26
win_ratio: 0.5269980119284294
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.320429801940918s
Received healthy response to inference request in 4.532782077789307s
Received healthy response to inference request in 3.865283727645874s
Received healthy response to inference request in 1.2453773021697998s
Received healthy response to inference request in 2.3859925270080566s
5 requests
0 failed requests
5th percentile: 1.4735003471374513
10th percentile: 1.7016233921051025
20th percentile: 2.157869482040405
30th percentile: 2.572879981994629
40th percentile: 2.9466548919677735
50th percentile: 3.320429801940918
60th percentile: 3.5383713722229
70th percentile: 3.756312942504883
80th percentile: 3.998783397674561
90th percentile: 4.265782737731934
95th percentile: 4.39928240776062
99th percentile: 4.506082143783569
mean time: 3.069973087310791
%s, retrying in %s seconds...
Received healthy response to inference request in 2.1032960414886475s
Received healthy response to inference request in 2.9864203929901123s
Received healthy response to inference request in 4.560636520385742s
Received healthy response to inference request in 3.8810818195343018s
Received healthy response to inference request in 3.4805386066436768s
5 requests
0 failed requests
5th percentile: 2.2799209117889405
10th percentile: 2.4565457820892336
20th percentile: 2.8097955226898192
30th percentile: 3.0852440357208253
40th percentile: 3.282891321182251
50th percentile: 3.4805386066436768
60th percentile: 3.6407558917999268
70th percentile: 3.8009731769561768
80th percentile: 4.01699275970459
90th percentile: 4.288814640045166
95th percentile: 4.424725580215454
99th percentile: 4.533454332351685
mean time: 3.402394676208496
%s, retrying in %s seconds...
Received healthy response to inference request in 5.371312856674194s
Received healthy response to inference request in 3.469064950942993s
Received healthy response to inference request in 3.089046001434326s
Received healthy response to inference request in 3.3647215366363525s
Received healthy response to inference request in 3.0654923915863037s
5 requests
0 failed requests
5th percentile: 3.070203113555908
10th percentile: 3.074913835525513
20th percentile: 3.084335279464722
30th percentile: 3.1441811084747315
40th percentile: 3.254451322555542
50th percentile: 3.3647215366363525
60th percentile: 3.4064589023590086
70th percentile: 3.448196268081665
80th percentile: 3.8495145320892337
90th percentile: 4.610413694381714
95th percentile: 4.990863275527953
99th percentile: 5.295222940444946
mean time: 3.671927547454834
Pipeline stage StressChecker completed in 54.80s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 5.38s
Shutdown handler de-registered
function_halum_2024-10-27 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 2, running shutdown handler
Shutdown handler de-registered
function_halum_2024-10-27 status is now torndown due to DeploymentManager action