developer_uid: rirv938
submission_id: function_riper_2024-12-28
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-12-28T15:34:20+00:00
num_battles: 14172
num_wins: 7197
celo_rating: 1269.84
family_friendly_score: 0.5962000000000001
family_friendly_standard_error: 0.006938956117457438
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-28
win_ratio: 0.5078323454699407
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.3797764778137207s
Received healthy response to inference request in 1.9184505939483643s
Received healthy response to inference request in 2.448410749435425s
Received healthy response to inference request in 5.483184099197388s
Received healthy response to inference request in 3.2263259887695312s
5 requests
0 failed requests
5th percentile: 2.0244426250457765
10th percentile: 2.1304346561431884
20th percentile: 2.3424187183380125
30th percentile: 2.603993797302246
40th percentile: 2.915159893035889
50th percentile: 3.2263259887695312
60th percentile: 3.287706184387207
70th percentile: 3.349086380004883
80th percentile: 3.8004580020904544
90th percentile: 4.641821050643921
95th percentile: 5.062502574920654
99th percentile: 5.3990477943420405
mean time: 3.291229581832886
Pipeline stage StressChecker completed in 17.82s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.73s
Shutdown handler de-registered
function_riper_2024-12-28 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3155.98s
Shutdown handler de-registered
function_riper_2024-12-28 status is now inactive due to auto deactivation removed underperforming models
function_riper_2024-12-28 status is now torndown due to DeploymentManager action
ChatRequest
Generation Params
Prompt Formatter
Chat History
ChatMessage 1