submission_id: function_dogom_2024-10-24
developer_uid: chai_backend_admin
celo_rating: 1246.43
display_name: retune_with_base
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 10363
num_wins: 5823
ranking_group: single
status: inactive
submission_type: function
timestamp: 2024-10-24T00:41:22+00:00
us_pacific_date: 2024-10-23
win_ratio: 0.5619029238637461
Download Preference Data
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.598745346069336s
Received healthy response to inference request in 1.373831033706665s
Received healthy response to inference request in 1.7122561931610107s
Received healthy response to inference request in 0.956331729888916s
Received healthy response to inference request in 1.6106534004211426s
5 requests
0 failed requests
5th percentile: 1.0398315906524658
10th percentile: 1.1233314514160155
20th percentile: 1.2903311729431153
30th percentile: 1.4188138961791992
40th percentile: 1.5087796211242677
50th percentile: 1.598745346069336
60th percentile: 1.6035085678100587
70th percentile: 1.6082717895507812
80th percentile: 1.6309739589691161
90th percentile: 1.6716150760650634
95th percentile: 1.6919356346130372
99th percentile: 1.708192081451416
mean time: 1.450363540649414
Pipeline stage StressChecker completed in 8.58s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.30s
Shutdown handler de-registered
function_dogom_2024-10-24 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
clean up pipeline due to error=DeploymentChecksError("Can't pickle <function model_plus_reward at 0x7efc32fd8e00>: attribute lookup model_plus_reward on __main__ failed")
Shutdown handler de-registered
function_dogom_2024-10-24 status is now inactive due to auto deactivation removed underperforming models