developer_uid: chai_backend_admin
submission_id: function_jepum_2024-11-29
model_name: retune_with_base
model_group:
status: inactive
timestamp: 2024-11-29T02:10:00+00:00
num_battles: 10034
num_wins: 4983
celo_rating: 1259.01
family_friendly_score: 0.5896
family_friendly_standard_error: 0.0069566060690540756
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-11-28
win_ratio: 0.4966115208291808
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.3505847454071045s
Received healthy response to inference request in 3.1076152324676514s
Received healthy response to inference request in 3.45320725440979s
Received healthy response to inference request in 3.1879570484161377s
Received healthy response to inference request in 5.585865020751953s
5 requests
0 failed requests
5th percentile: 2.5019908428192137
10th percentile: 2.6533969402313233
20th percentile: 2.956209135055542
30th percentile: 3.1236835956573485
40th percentile: 3.1558203220367433
50th percentile: 3.1879570484161377
60th percentile: 3.2940571308135986
70th percentile: 3.4001572132110596
80th percentile: 3.879738807678223
90th percentile: 4.732801914215088
95th percentile: 5.1593334674835205
99th percentile: 5.500558710098266
mean time: 3.5370458602905273
Pipeline stage StressChecker completed in 18.82s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.42s
Shutdown handler de-registered
function_jepum_2024-11-29 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 4094.75s
Shutdown handler de-registered
function_jepum_2024-11-29 status is now inactive due to auto deactivation removed underperforming models