developer_uid: chai_backend_admin
submission_id: function_gajom_2024-11-22
model_name: retune_with_base
model_group:
status: inactive
timestamp: 2024-11-22T22:53:18+00:00
num_battles: 17208
num_wins: 8713
celo_rating: 1267.97
family_friendly_score: 0.5876
family_friendly_standard_error: 0.006961698643291018
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-11-22
win_ratio: 0.5063342631334263
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.6500442028045654s
Received healthy response to inference request in 4.1707541942596436s
Received healthy response to inference request in 1.8080034255981445s
Received healthy response to inference request in 2.3706400394439697s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 2.6687216758728027s
5 requests
0 failed requests
5th percentile: 1.9205307483673095
Connection pool is full, discarding connection: %s. Connection pool size: %s
10th percentile: 2.0330580711364745
20th percentile: 2.2581127166748045
30th percentile: 2.4265208721160887
40th percentile: 2.538282537460327
50th percentile: 2.6500442028045654
60th percentile: 2.6575151920318603
70th percentile: 2.664986181259155
80th percentile: 2.969128179550171
90th percentile: 3.5699411869049076
95th percentile: 3.870347690582275
99th percentile: 4.110672893524169
mean time: 2.733632707595825
Pipeline stage StressChecker completed in 15.04s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.30s
Shutdown handler de-registered
function_gajom_2024-11-22 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3253.92s
Shutdown handler de-registered
function_gajom_2024-11-22 status is now inactive due to auto deactivation removed underperforming models