developer_uid: chai_backend_admin
submission_id: function_jatil_2024-11-23
model_name: retune_with_base
model_group:
status: inactive
timestamp: 2024-11-23T01:03:41+00:00
num_battles: 15380
num_wins: 7940
celo_rating: 1279.62
family_friendly_score: 0.5822
family_friendly_standard_error: 0.006974857131153297
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-11-22
win_ratio: 0.5162548764629389
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.657254457473755s
Received healthy response to inference request in 3.6190285682678223s
Received healthy response to inference request in 2.546121120452881s
Received healthy response to inference request in 2.4566526412963867s
Received healthy response to inference request in 2.166881561279297s
5 requests
0 failed requests
5th percentile: 2.2248357772827148
10th percentile: 2.2827899932861326
20th percentile: 2.398698425292969
30th percentile: 2.4745463371276855
40th percentile: 2.5103337287902834
50th percentile: 2.546121120452881
60th percentile: 2.5905744552612306
70th percentile: 2.63502779006958
80th percentile: 2.8496092796325687
90th percentile: 3.2343189239501955
95th percentile: 3.4266737461090084
99th percentile: 3.5805576038360596
mean time: 2.6891876697540282
Pipeline stage StressChecker completed in 14.72s
run pipeline stage %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.73s
Shutdown handler de-registered
function_jatil_2024-11-23 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2452.14s
Shutdown handler de-registered
function_jatil_2024-11-23 status is now inactive due to auto deactivation removed underperforming models