function_kenis_2024-11-27

developer_uid: chai_backend_admin

submission_id: function_kenis_2024-11-27

model_name: retune_with_base

model_group:

status: inactive

timestamp: 2024-11-27T20:11:40+00:00

num_battles: 13579

num_wins: 6942

celo_rating: 1267.98

family_friendly_score: 0.5786

family_friendly_standard_error: 0.006983151723971061

submission_type: function

display_name: retune_with_base

is_internal_developer: True

ranking_group: single

us_pacific_date: 2024-11-27

win_ratio: 0.511230576625672

generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.8080451488494873s
Received healthy response to inference request in 2.5739951133728027s
Received healthy response to inference request in 2.822711944580078s
Received healthy response to inference request in 2.4927978515625s
Received healthy response to inference request in 2.8533935546875s
5 requests
0 failed requests
5th percentile: 2.5090373039245604
10th percentile: 2.525276756286621
20th percentile: 2.5577556610107424
30th percentile: 2.6208051204681397
40th percentile: 2.7144251346588133
50th percentile: 2.8080451488494873
60th percentile: 2.813911867141724
70th percentile: 2.81977858543396
80th percentile: 2.8288482666015624
90th percentile: 2.8411209106445314
95th percentile: 2.8472572326660157
99th percentile: 2.8521662902832032
mean time: 2.7101887226104737
Pipeline stage StressChecker completed in 14.65s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.12s
Shutdown handler de-registered
function_kenis_2024-11-27 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3062.02s
Shutdown handler de-registered
function_kenis_2024-11-27 status is now inactive due to auto deactivation removed underperforming models