function_mamib_2024-11-29

developer_uid: chai_backend_admin

submission_id: function_mamib_2024-11-29

model_name: retune_with_base

model_group:

status: inactive

timestamp: 2024-11-29T00:02:13+00:00

num_battles: 9972

num_wins: 4959

celo_rating: 1262.32

family_friendly_score: 0.594

family_friendly_standard_error: 0.006944983801277006

submission_type: function

display_name: retune_with_base

is_internal_developer: True

ranking_group: single

us_pacific_date: 2024-11-28

win_ratio: 0.4972924187725632

generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.671715021133423s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 2.462254285812378s
Received healthy response to inference request in 2.8804965019226074s
Received healthy response to inference request in 3.867701530456543s
Received healthy response to inference request in 3.204904317855835s
5 requests
0 failed requests
5th percentile: 2.545902729034424
10th percentile: 2.6295511722564697
20th percentile: 2.7968480587005615
30th percentile: 2.945378065109253
40th percentile: 3.075141191482544
50th percentile: 3.204904317855835
60th percentile: 3.39162859916687
70th percentile: 3.578352880477905
80th percentile: 3.710912322998047
90th percentile: 3.7893069267272947
95th percentile: 3.828504228591919
99th percentile: 3.859862070083618
mean time: 3.2174143314361574
Pipeline stage StressChecker completed in 17.21s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.12s
Shutdown handler de-registered
function_mamib_2024-11-29 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3983.46s
Shutdown handler de-registered
function_mamib_2024-11-29 status is now inactive due to auto deactivation removed underperforming models