submission_id: function_taluk_2024-11-21
developer_uid: chai_backend_admin
celo_rating: 1228.14
display_name: retune_with_base
family_friendly_score: 0.5808
family_friendly_standard_error: 0.006978128115762852
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 6742
num_wins: 3258
ranking_group: single
status: inactive
submission_type: function
timestamp: 2024-11-21T01:24:52+00:00
us_pacific_date: 2024-11-20
win_ratio: 0.4832393948383269
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.1717283725738525s
Received healthy response to inference request in 2.373039960861206s
Received healthy response to inference request in 2.405991315841675s
Received healthy response to inference request in 2.5563721656799316s
Received healthy response to inference request in 2.013253688812256s
5 requests
0 failed requests
5th percentile: 2.044948625564575
10th percentile: 2.0766435623168946
20th percentile: 2.1400334358215334
30th percentile: 2.2119906902313233
40th percentile: 2.2925153255462645
50th percentile: 2.373039960861206
60th percentile: 2.3862205028533934
70th percentile: 2.399401044845581
80th percentile: 2.436067485809326
90th percentile: 2.496219825744629
95th percentile: 2.5262959957122804
99th percentile: 2.550356931686401
mean time: 2.3040771007537844
Pipeline stage StressChecker completed in 12.89s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.62s
Shutdown handler de-registered
function_taluk_2024-11-21 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2696.16s
Shutdown handler de-registered
function_taluk_2024-11-21 status is now inactive due to auto deactivation removed underperforming models