developer_uid: chai_backend_admin
submission_id: function_temut_2024-11-22
model_name: retune_with_base
model_group:
status: inactive
timestamp: 2024-11-22T18:56:52+00:00
num_battles: 14196
num_wins: 7681
celo_rating: 1280.65
family_friendly_score: 0.5833999999999999
family_friendly_standard_error: 0.006972007458401059
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-11-22
win_ratio: 0.5410679064525218
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.07472562789917s
Received healthy response to inference request in 2.3110365867614746s
Received healthy response to inference request in 3.306560754776001s
Received healthy response to inference request in 2.5933151245117188s
Received healthy response to inference request in 2.575483560562134s
5 requests
0 failed requests
5th percentile: 2.3639259815216063
10th percentile: 2.4168153762817384
20th percentile: 2.522594165802002
30th percentile: 2.5790498733520506
40th percentile: 2.5861824989318847
50th percentile: 2.5933151245117188
60th percentile: 2.7858793258666994
70th percentile: 2.9784435272216796
80th percentile: 3.121092653274536
90th percentile: 3.2138267040252684
95th percentile: 3.2601937294006347
99th percentile: 3.2972873497009276
mean time: 2.7722243309020995
Pipeline stage StressChecker completed in 15.70s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.53s
Shutdown handler de-registered
function_temut_2024-11-22 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3648.82s
Shutdown handler de-registered
function_temut_2024-11-22 status is now inactive due to auto deactivation removed underperforming models