developer_uid: chai_backend_admin
submission_id: function_jijit_2024-12-09
model_name: retune_with_base
model_group:
status: inactive
timestamp: 2024-12-09T00:33:50+00:00
num_battles: 13948
num_wins: 7068
celo_rating: 1267.13
family_friendly_score: 0.6155999999999999
family_friendly_standard_error: 0.006879486027313377
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-08
win_ratio: 0.5067393174648696
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.8643338680267334s
Received healthy response to inference request in 2.9741127490997314s
Received healthy response to inference request in 2.9312634468078613s
Received healthy response to inference request in 2.978447675704956s
Received healthy response to inference request in 3.3248608112335205s
5 requests
0 failed requests
5th percentile: 2.877719783782959
10th percentile: 2.8911056995391844
20th percentile: 2.917877531051636
30th percentile: 2.9398333072662353
40th percentile: 2.9569730281829836
50th percentile: 2.9741127490997314
60th percentile: 2.9758467197418215
70th percentile: 2.977580690383911
80th percentile: 3.047730302810669
90th percentile: 3.1862955570220945
95th percentile: 3.2555781841278075
99th percentile: 3.311004285812378
mean time: 3.0146037101745606
Pipeline stage StressChecker completed in 16.16s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.20s
Shutdown handler de-registered
function_jijit_2024-12-09 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3402.80s
Shutdown handler de-registered
function_jijit_2024-12-09 status is now inactive due to auto deactivation removed underperforming models