function_danob_2024-12-07

developer_uid: chai_backend_admin

submission_id: function_danob_2024-12-07

model_name: retune_with_base

model_group:

status: inactive

timestamp: 2024-12-07T03:14:49+00:00

num_battles: 68882

num_wins: 34570

celo_rating: 1261.97

family_friendly_score: 0.0

family_friendly_standard_error: 0.0

submission_type: function

display_name: retune_with_base

is_internal_developer: True

ranking_group: single

us_pacific_date: 2024-12-06

win_ratio: 0.5018727679219535

generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
{"detail":"no entry with id \"fakey_test\" found on database!"}
Received unhealthy response to inference request!
Received healthy response to inference request in 2.6678590774536133s
Received healthy response to inference request in 2.2657132148742676s
Received healthy response to inference request in 2.055950403213501s
Received healthy response to inference request in 2.4515554904937744s
5 requests
1 failed requests
5th percentile: 2.0979029655456545
10th percentile: 2.1398555278778075
20th percentile: 2.223760652542114
30th percentile: 2.302881669998169
40th percentile: 2.3772185802459718
50th percentile: 2.4515554904937744
60th percentile: 2.53807692527771
70th percentile: 2.6245983600616456
80th percentile: 2.7103201389312743
90th percentile: 2.795242261886597
95th percentile: 2.837703323364258
99th percentile: 2.8716721725463867
mean time: 2.464248514175415
%s, retrying in %s seconds...
Received healthy response to inference request in 3.344970226287842s
Received healthy response to inference request in 1.7510817050933838s
Received healthy response to inference request in 2.7688465118408203s
Received healthy response to inference request in 2.4264209270477295s
Failed to get response for submission function_jehom_2024-12-07: no entry with id "fakey_test" found on database!
Received healthy response to inference request in 3.3584136962890625s
5 requests
0 failed requests
5th percentile: 1.8861495494842528
10th percentile: 2.021217393875122
20th percentile: 2.2913530826568604
30th percentile: 2.4949060440063477
40th percentile: 2.631876277923584
50th percentile: 2.7688465118408203
60th percentile: 2.9992959976196287
70th percentile: 3.2297454833984376
80th percentile: 3.3476589202880858
90th percentile: 3.353036308288574
95th percentile: 3.3557250022888185
99th percentile: 3.357875957489014
mean time: 2.7299466133117676
Pipeline stage StressChecker completed in 28.26s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.36s
Shutdown handler de-registered
function_danob_2024-12-07 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
clean up pipeline due to error=DeploymentChecksError('no entry with id "fakey_test" found on database!')
Shutdown handler de-registered
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
clean up pipeline due to error=DeploymentChecksError('no entry with id "fakey_test" found on database!')
Shutdown handler de-registered
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
clean up pipeline due to error=DeploymentChecksError('no entry with id "fakey_test" found on database!')
Shutdown handler de-registered
function_danob_2024-12-07 status is now inactive due to auto deactivation removed underperforming models