developer_uid: chai_backend_admin
submission_id: function_sosuf_2024-11-27
model_name: retune_with_base
model_group:
status: inactive
timestamp: 2024-11-27T21:07:24+00:00
num_battles: 15825
num_wins: 7750
celo_rating: 1254.03
family_friendly_score: 0.5818
family_friendly_standard_error: 0.006975797588806602
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-11-27
win_ratio: 0.48973143759873616
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.765935182571411s
Received healthy response to inference request in 1.9037542343139648s
Received healthy response to inference request in 2.507012367248535s
Received healthy response to inference request in 1.7832612991333008s
Received healthy response to inference request in 3.1893997192382812s
5 requests
0 failed requests
5th percentile: 1.8073598861694335
10th percentile: 1.8314584732055663
20th percentile: 1.879655647277832
30th percentile: 2.024405860900879
40th percentile: 2.265709114074707
50th percentile: 2.507012367248535
60th percentile: 2.7799673080444336
70th percentile: 3.052922248840332
80th percentile: 3.3047068119049072
90th percentile: 3.535320997238159
95th percentile: 3.650628089904785
99th percentile: 3.742873764038086
mean time: 2.6298725605010986
Pipeline stage StressChecker completed in 14.22s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.18s
Shutdown handler de-registered
function_sosuf_2024-11-27 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3044.82s
Shutdown handler de-registered
function_sosuf_2024-11-27 status is now inactive due to auto deactivation removed underperforming models