developer_uid: chai_backend_admin
submission_id: function_futar_2025-05-30
model_name: function_futar_2025-05-30
model_group:
status: torndown
timestamp: 2025-05-30T18:13:37+00:00
num_battles: 6517
num_wins: 3332
celo_rating: 1292.81
family_friendly_score: 0.5032
family_friendly_standard_error: 0.007070922994913747
submission_type: function
display_name: function_futar_2025-05-30
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-05-30
win_ratio: 0.5112781954887218
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.4218790531158447s
Received healthy response to inference request in 2.5882277488708496s
Received healthy response to inference request in 1.5777885913848877s
Received healthy response to inference request in 1.61110258102417s
Received healthy response to inference request in 1.5435986518859863s
5 requests
0 failed requests
5th percentile: 1.5504366397857665
10th percentile: 1.557274627685547
20th percentile: 1.5709506034851075
30th percentile: 1.584451389312744
40th percentile: 1.5977769851684571
50th percentile: 1.61110258102417
60th percentile: 1.9354131698608397
70th percentile: 2.2597237586975094
80th percentile: 2.455148792266846
90th percentile: 2.5216882705688475
95th percentile: 2.5549580097198485
99th percentile: 2.5815738010406495
mean time: 1.9485193252563477
Pipeline stage StressChecker completed in 10.76s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.60s
Shutdown handler de-registered
function_futar_2025-05-30 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2149.47s
Shutdown handler de-registered
function_futar_2025-05-30 status is now inactive due to auto deactivation removed underperforming models
function_futar_2025-05-30 status is now torndown due to DeploymentManager action