developer_uid: chai_backend_admin
submission_id: function_panob_2024-12-08
model_name: retune_with_base
model_group:
status: inactive
timestamp: 2024-12-08T06:56:58+00:00
num_battles: 12244
num_wins: 6350
celo_rating: 1274.7
family_friendly_score: 0.6002000000000001
family_friendly_standard_error: 0.006927625278549642
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-07
win_ratio: 0.5186213655668083
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.513333797454834s
Received healthy response to inference request in 2.8364322185516357s
Received healthy response to inference request in 3.788874387741089s
Received healthy response to inference request in 2.784987449645996s
Received healthy response to inference request in 2.3185431957244873s
5 requests
0 failed requests
5th percentile: 2.3575013160705565
10th percentile: 2.396459436416626
20th percentile: 2.474375677108765
30th percentile: 2.5676645278930663
40th percentile: 2.6763259887695314
50th percentile: 2.784987449645996
60th percentile: 2.805565357208252
70th percentile: 2.826143264770508
80th percentile: 3.0269206523895265
90th percentile: 3.407897520065308
95th percentile: 3.598385953903198
99th percentile: 3.750776700973511
mean time: 2.8484342098236084
Pipeline stage StressChecker completed in 15.93s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.43s
Shutdown handler de-registered
function_panob_2024-12-08 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3023.81s
Shutdown handler de-registered
function_panob_2024-12-08 status is now inactive due to auto deactivation removed underperforming models