submission_id: function_reten_2024-10-24
developer_uid: chai_backend_admin
celo_rating: 1186.9
display_name: retune_with_base
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 10161
num_wins: 4482
ranking_group: single
status: inactive
submission_type: function
timestamp: 2024-10-24T00:42:08+00:00
us_pacific_date: 2024-10-23
win_ratio: 0.44109831709477415
Download Preference Data
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.6142375469207764s
Received healthy response to inference request in 1.339409351348877s
Received healthy response to inference request in 1.7202999591827393s
Received healthy response to inference request in 1.5227277278900146s
Received healthy response to inference request in 1.5589792728424072s
5 requests
0 failed requests
5th percentile: 1.3760730266571044
10th percentile: 1.412736701965332
20th percentile: 1.4860640525817872
30th percentile: 1.5299780368804932
40th percentile: 1.5444786548614502
50th percentile: 1.5589792728424072
60th percentile: 1.5810825824737549
70th percentile: 1.6031858921051025
80th percentile: 1.6354500293731689
90th percentile: 1.677874994277954
95th percentile: 1.6990874767303468
99th percentile: 1.7160574626922607
mean time: 1.551130771636963
Pipeline stage StressChecker completed in 9.27s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 5.61s
Shutdown handler de-registered
function_reten_2024-10-24 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
clean up pipeline due to error=DeploymentChecksError("Can't pickle <function model_plus_reward at 0x7f5abc860e00>: attribute lookup model_plus_reward on __main__ failed")
Shutdown handler de-registered
function_reten_2024-10-24 status is now inactive due to auto deactivation removed underperforming models