developer_uid: chai_backend_admin
submission_id: function_mihib_2024-12-08
model_name: retune_with_base
model_group:
status: inactive
timestamp: 2024-12-08T06:57:35+00:00
num_battles: 11997
num_wins: 5868
celo_rating: 1255.83
family_friendly_score: 0.616
family_friendly_standard_error: 0.006878139283265497
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-07
win_ratio: 0.4891222805701425
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.691439390182495s
Received healthy response to inference request in 2.938321113586426s
Received healthy response to inference request in 2.9075708389282227s
Received healthy response to inference request in 4.209567546844482s
Received healthy response to inference request in 2.557528018951416s
5 requests
0 failed requests
5th percentile: 2.584310293197632
10th percentile: 2.6110925674438477
20th percentile: 2.6646571159362793
30th percentile: 2.7346656799316404
40th percentile: 2.8211182594299316
50th percentile: 2.9075708389282227
60th percentile: 2.919870948791504
70th percentile: 2.9321710586547853
80th percentile: 3.1925704002380373
90th percentile: 3.70106897354126
95th percentile: 3.955318260192871
99th percentile: 4.15871768951416
mean time: 3.0608853816986086
Pipeline stage StressChecker completed in 16.62s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.45s
Shutdown handler de-registered
function_mihib_2024-12-08 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3008.66s
Shutdown handler de-registered
function_mihib_2024-12-08 status is now inactive due to auto deactivation removed underperforming models