developer_uid: chai_backend_admin
submission_id: function_dajef_2024-11-27
model_name: retune_with_base
model_group:
status: inactive
timestamp: 2024-11-27T20:09:29+00:00
num_battles: 10141
num_wins: 4969
celo_rating: 1254.27
family_friendly_score: 0.5782
family_friendly_standard_error: 0.006984049828000943
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-11-27
win_ratio: 0.4899911251355882
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.441577672958374s
Received healthy response to inference request in 2.1618587970733643s
Received healthy response to inference request in 2.875476360321045s
Received healthy response to inference request in 2.1517953872680664s
Received healthy response to inference request in 2.7767443656921387s
5 requests
0 failed requests
5th percentile: 2.153808069229126
10th percentile: 2.1558207511901855
20th percentile: 2.1598461151123045
30th percentile: 2.217802572250366
40th percentile: 2.32969012260437
50th percentile: 2.441577672958374
60th percentile: 2.57564435005188
70th percentile: 2.7097110271453855
80th percentile: 2.79649076461792
90th percentile: 2.8359835624694822
95th percentile: 2.8557299613952636
99th percentile: 2.8715270805358886
mean time: 2.4814905166625976
Pipeline stage StressChecker completed in 13.53s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.10s
Shutdown handler de-registered
function_dajef_2024-11-27 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3294.61s
Shutdown handler de-registered
function_dajef_2024-11-27 status is now inactive due to auto deactivation removed underperforming models