function_ramuk_2024-11-19

submission_id: function_ramuk_2024-11-19

developer_uid: chai_backend_admin

celo_rating: 1250.8

display_name: retune_with_base

family_friendly_score: 0.5878

family_friendly_standard_error: 0.006961194725045407

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

is_internal_developer: True

model_group:

model_name: retune_with_base

num_battles: 8750

num_wins: 4384

ranking_group: single

status: inactive

submission_type: function

timestamp: 2024-11-19T17:31:14+00:00

us_pacific_date: 2024-11-19

win_ratio: 0.5010285714285714

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.215134620666504s
Received healthy response to inference request in 3.531764030456543s
Received healthy response to inference request in 4.9131920337677s
Received healthy response to inference request in 2.5042428970336914s
Received healthy response to inference request in 3.8108584880828857s
5 requests
0 failed requests
5th percentile: 2.6464212417602537
10th percentile: 2.7885995864868165
20th percentile: 3.0729562759399416
30th percentile: 3.2784605026245117
40th percentile: 3.4051122665405273
50th percentile: 3.531764030456543
60th percentile: 3.6434018135070803
70th percentile: 3.755039596557617
80th percentile: 4.031325197219849
90th percentile: 4.472258615493774
95th percentile: 4.692725324630737
99th percentile: 4.869098691940308
mean time: 3.595038414001465
%s, retrying in %s seconds...
Received healthy response to inference request in 3.393742084503174s
Received healthy response to inference request in 2.5345189571380615s
Received healthy response to inference request in 2.8382210731506348s
Received healthy response to inference request in 2.6053011417388916s
Received healthy response to inference request in 4.143834114074707s
5 requests
0 failed requests
5th percentile: 2.5486753940582276
10th percentile: 2.5628318309783937
20th percentile: 2.5911447048187255
30th percentile: 2.6518851280212403
40th percentile: 2.7450531005859373
50th percentile: 2.8382210731506348
60th percentile: 3.0604294776916503
70th percentile: 3.282637882232666
80th percentile: 3.5437604904174806
90th percentile: 3.843797302246094
95th percentile: 3.9938157081604
99th percentile: 4.113830432891846
mean time: 3.1031234741210936
Pipeline stage StressChecker completed in 36.19s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.46s
Shutdown handler de-registered
function_ramuk_2024-11-19 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3227.45s
Shutdown handler de-registered
function_ramuk_2024-11-19 status is now inactive due to auto deactivation removed underperforming models