developer_uid: chai_backend_admin
submission_id: function_lefet_2024-11-22
model_name: retune_with_base
model_group:
status: inactive
timestamp: 2024-11-22T02:43:22+00:00
num_battles: 11348
num_wins: 5913
celo_rating: 1266.85
family_friendly_score: 0.5740000000000001
family_friendly_standard_error: 0.006993196693930466
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-11-21
win_ratio: 0.5210609799083539
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.124718427658081s
Received healthy response to inference request in 3.0445148944854736s
Received healthy response to inference request in 2.1359732151031494s
Received healthy response to inference request in 3.6357173919677734s
Received healthy response to inference request in 3.6630258560180664s
5 requests
0 failed requests
5th percentile: 2.1269693851470945
10th percentile: 2.1292203426361085
20th percentile: 2.133722257614136
30th percentile: 2.3176815509796143
40th percentile: 2.681098222732544
50th percentile: 3.0445148944854736
60th percentile: 3.2809958934783934
70th percentile: 3.5174768924713136
80th percentile: 3.641179084777832
90th percentile: 3.652102470397949
95th percentile: 3.657564163208008
99th percentile: 3.6619335174560548
mean time: 2.920789957046509
Pipeline stage StressChecker completed in 16.73s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.41s
Shutdown handler de-registered
function_lefet_2024-11-22 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3797.80s
Shutdown handler de-registered
function_lefet_2024-11-22 status is now inactive due to auto deactivation removed underperforming models