developer_uid: chai_backend_admin
submission_id: function_gunof_2024-11-12
model_name: retune_with_base
model_group:
status: inactive
timestamp: 2024-11-12T19:59:09+00:00
num_battles: 21636
num_wins: 11393
celo_rating: 1260.74
family_friendly_score: 0.6032
family_friendly_standard_error: 0.006918811458624956
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-11-12
win_ratio: 0.5265760769088557
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.466359853744507s
Received healthy response to inference request in 1.890272617340088s
Received healthy response to inference request in 19.738666534423828s
Received healthy response to inference request in 3.458845853805542s
Received healthy response to inference request in 3.1632332801818848s
5 requests
0 failed requests
5th percentile: 2.1448647499084474
10th percentile: 2.3994568824768066
20th percentile: 2.908641147613525
30th percentile: 3.2223557949066164
40th percentile: 3.340600824356079
50th percentile: 3.458845853805542
60th percentile: 3.461851453781128
70th percentile: 3.464857053756714
80th percentile: 6.720821189880374
90th percentile: 13.229743862152102
95th percentile: 16.48420519828796
99th percentile: 19.087774267196654
mean time: 6.34347562789917
Pipeline stage StressChecker completed in 32.99s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.79s
Shutdown handler de-registered
function_gunof_2024-11-12 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3378.33s
Shutdown handler de-registered
function_gunof_2024-11-12 status is now inactive due to auto deactivation removed underperforming models