function_lopat_2024-11-06

submission_id: function_lopat_2024-11-06

developer_uid: chai_backend_admin

celo_rating: 1239.12

display_name: retune_with_base

family_friendly_score: 0.5998

family_friendly_standard_error: 0.006928779979188255

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

is_internal_developer: True

model_group:

model_name: retune_with_base

num_battles: 25986

num_wins: 13845

ranking_group: single

status: inactive

submission_type: function

timestamp: 2024-11-06T22:26:55+00:00

us_pacific_date: 2024-11-06

win_ratio: 0.5327868852459017

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.5724196434020996s
Received healthy response to inference request in 3.409174919128418s
Received healthy response to inference request in 4.297644138336182s
Received healthy response to inference request in 2.0838353633880615s
Received healthy response to inference request in 3.386854410171509s
5 requests
0 failed requests
5th percentile: 2.344439172744751
10th percentile: 2.6050429821014403
20th percentile: 3.1262506008148194
30th percentile: 3.391318511962891
40th percentile: 3.4002467155456544
50th percentile: 3.409174919128418
60th percentile: 3.4744728088378904
70th percentile: 3.5397706985473634
80th percentile: 3.717464542388916
90th percentile: 4.007554340362549
95th percentile: 4.152599239349365
99th percentile: 4.268635158538818
mean time: 3.349985694885254
Pipeline stage StressChecker completed in 18.47s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.21s
Shutdown handler de-registered
function_lopat_2024-11-06 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 4462.23s
Shutdown handler de-registered
function_lopat_2024-11-06 status is now inactive due to auto deactivation removed underperforming models