submission_id: function_lidib_2024-11-15
developer_uid: chai_backend_admin
celo_rating: 1250.62
display_name: retune_with_base
family_friendly_score: 0.5818
family_friendly_standard_error: 0.006975797588806602
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 11046
num_wins: 5606
ranking_group: single
status: inactive
submission_type: function
timestamp: 2024-11-15T21:26:54+00:00
us_pacific_date: 2024-11-15
win_ratio: 0.5075140322288612
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.932462215423584s
Retrying (%r) after connection broken by '%r': %s
Received healthy response to inference request in 2.190826892852783s
Retrying (%r) after connection broken by '%r': %s
Received healthy response to inference request in 1.9096050262451172s
Retrying (%r) after connection broken by '%r': %s
Retrying (%r) after connection broken by '%r': %s
Retrying (%r) after connection broken by '%r': %s
Received healthy response to inference request in 2.021526575088501s
Retrying (%r) after connection broken by '%r': %s
Retrying (%r) after connection broken by '%r': %s
Retrying (%r) after connection broken by '%r': %s
Retrying (%r) after connection broken by '%r': %s
Received healthy response to inference request in 2.0318570137023926s
5 requests
0 failed requests
5th percentile: 1.9319893360137939
10th percentile: 1.9543736457824707
20th percentile: 1.9991422653198243
30th percentile: 2.0235926628112795
40th percentile: 2.027724838256836
50th percentile: 2.0318570137023926
60th percentile: 2.0954449653625487
70th percentile: 2.159032917022705
80th percentile: 2.3391539573669435
90th percentile: 2.6358080863952638
95th percentile: 2.7841351509094237
Retrying (%r) after connection broken by '%r': %s
Retrying (%r) after connection broken by '%r': %s
99th percentile: 2.902796802520752
mean time: 2.2172555446624758
Pipeline stage StressChecker completed in 12.56s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
Retrying (%r) after connection broken by '%r': %s
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
Retrying (%r) after connection broken by '%r': %s
Retrying (%r) after connection broken by '%r': %s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.24s
Shutdown handler de-registered
function_lidib_2024-11-15 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3935.99s
Shutdown handler de-registered
function_lidib_2024-11-15 status is now inactive due to auto deactivation removed underperforming models