function_lemem_2024-12-07

developer_uid: chai_backend_admin

submission_id: function_lemem_2024-12-07

model_name: retune_with_base

model_group:

status: inactive

timestamp: 2024-12-07T02:32:56+00:00

num_battles: 8823

num_wins: 4442

celo_rating: 1268.65

family_friendly_score: 0.5582

family_friendly_standard_error: 0.007023001637476671

submission_type: function

display_name: retune_with_base

is_internal_developer: True

ranking_group: single

us_pacific_date: 2024-12-06

win_ratio: 0.5034568740791114

generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.3887381553649902s
Received healthy response to inference request in 2.2629265785217285s
Received healthy response to inference request in 2.3382349014282227s
Received healthy response to inference request in 2.3045406341552734s
Received healthy response to inference request in 1.942075490951538s
5 requests
0 failed requests
5th percentile: 2.0062457084655763
10th percentile: 2.0704159259796144
20th percentile: 2.1987563610076903
30th percentile: 2.2712493896484376
40th percentile: 2.2878950119018553
50th percentile: 2.3045406341552734
60th percentile: 2.318018341064453
70th percentile: 2.3314960479736326
80th percentile: 2.348335552215576
90th percentile: 2.368536853790283
95th percentile: 2.378637504577637
99th percentile: 2.3867180252075197
mean time: 2.2473031520843505
Pipeline stage StressChecker completed in 13.01s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.44s
Shutdown handler de-registered
function_lemem_2024-12-07 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2665.96s
Shutdown handler de-registered
function_lemem_2024-12-07 status is now inactive due to auto deactivation removed underperforming models