developer_uid: chai_backend_admin
submission_id: function_roson_2024-11-18
model_name: retune_with_base
model_group:
status: inactive
timestamp: 2024-11-18T18:08:32+00:00
num_battles: 13439
num_wins: 6865
celo_rating: 1261.85
family_friendly_score: 0.5771999999999999
family_friendly_standard_error: 0.0069862745437035325
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-11-18
win_ratio: 0.5108266984150607
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.4093284606933594s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 2.5711865425109863s
Received healthy response to inference request in 4.073958158493042s
Received healthy response to inference request in 3.846625566482544s
Received healthy response to inference request in 2.17301344871521s
5 requests
0 failed requests
5th percentile: 2.22027645111084
10th percentile: 2.26753945350647
20th percentile: 2.3620654582977294
30th percentile: 2.441700077056885
40th percentile: 2.5064433097839354
50th percentile: 2.5711865425109863
60th percentile: 3.0813621520996093
70th percentile: 3.5915377616882322
80th percentile: 3.8920920848846436
90th percentile: 3.9830251216888426
95th percentile: 4.028491640090943
99th percentile: 4.0648648548126225
mean time: 3.0148224353790285
Pipeline stage StressChecker completed in 16.40s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 3.01s
Shutdown handler de-registered
function_roson_2024-11-18 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3166.22s
Shutdown handler de-registered
function_roson_2024-11-18 status is now inactive due to auto deactivation removed underperforming models