developer_uid: chai_backend_admin
submission_id: function_nopar_2024-12-07
model_name: retune_with_base
model_group:
status: inactive
timestamp: 2024-12-07T03:13:32+00:00
num_battles: 70262
num_wins: 34771
celo_rating: 1259.13
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-06
win_ratio: 0.49487632005920695
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.270023822784424s
Received healthy response to inference request in 2.1282410621643066s
Received healthy response to inference request in 2.4983878135681152s
Received healthy response to inference request in 2.2782082557678223s
Received healthy response to inference request in 2.255619764328003s
5 requests
0 failed requests
5th percentile: 2.153716802597046
10th percentile: 2.179192543029785
20th percentile: 2.2301440238952637
30th percentile: 2.2601374626159667
40th percentile: 2.2691728591918947
50th percentile: 2.2782082557678223
60th percentile: 2.3662800788879395
70th percentile: 2.4543519020080566
80th percentile: 2.8527150154113774
90th percentile: 3.5613694190979004
95th percentile: 3.9156966209411617
99th percentile: 4.199158382415772
mean time: 2.6860961437225344
Pipeline stage StressChecker completed in 14.50s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.35s
Shutdown handler de-registered
function_nopar_2024-12-07 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
clean up pipeline due to error=DeploymentChecksError('no entry with id "fakey_test" found on database!')
Shutdown handler de-registered
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
clean up pipeline due to error=DeploymentChecksError('no entry with id "fakey_test" found on database!')
Shutdown handler de-registered
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
clean up pipeline due to error=DeploymentChecksError('no entry with id "fakey_test" found on database!')
Shutdown handler de-registered
function_nopar_2024-12-07 status is now inactive due to auto deactivation removed underperforming models