function_johab_2024-12-08

developer_uid: chai_backend_admin

submission_id: function_johab_2024-12-08

model_name: retune_with_base

model_group:

status: inactive

timestamp: 2024-12-08T03:32:09+00:00

num_battles: 12326

num_wins: 6523

celo_rating: 1281.38

family_friendly_score: 0.6004

family_friendly_standard_error: 0.006927046123709586

submission_type: function

display_name: retune_with_base

is_internal_developer: True

ranking_group: single

us_pacific_date: 2024-12-07

win_ratio: 0.529206555249067

generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.116851568222046s
Received healthy response to inference request in 3.368649959564209s
Received healthy response to inference request in 2.4739387035369873s
Received healthy response to inference request in 2.826881170272827s
Received healthy response to inference request in 3.434536933898926s
5 requests
0 failed requests
5th percentile: 2.544527196884155
10th percentile: 2.615115690231323
20th percentile: 2.7562926769256593
30th percentile: 2.9352349281311034
40th percentile: 3.1519424438476564
50th percentile: 3.368649959564209
60th percentile: 3.3950047492980957
70th percentile: 3.4213595390319824
80th percentile: 3.57099986076355
90th percentile: 3.843925714492798
95th percentile: 3.980388641357422
99th percentile: 4.0895589828491214
mean time: 3.244171667098999
Pipeline stage StressChecker completed in 17.32s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.20s
Shutdown handler de-registered
function_johab_2024-12-08 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3613.71s
Shutdown handler de-registered
function_johab_2024-12-08 status is now inactive due to auto deactivation removed underperforming models