function_tisif_2025-12-08

developer_uid: chai_backend_admin

submission_id: function_tisif_2025-12-08

model_name: function_tisif_2025-12-08

model_group:

status: torndown

timestamp: 2025-12-12T18:36:34+00:00

num_battles: 5789

num_wins: 3013

celo_rating: 1312.38

family_friendly_score: 0.5372

family_friendly_standard_error: 0.007051470201312631

submission_type: function

display_name: function_tisif_2025-12-08

is_internal_developer: True

ranking_group: single

us_pacific_date: 2025-12-08

win_ratio: 0.520469856624633

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.7122082710266113s
Received healthy response to inference request in 1.690765619277954s
Received healthy response to inference request in 2.602058172225952s
Received healthy response to inference request in 1.9300596714019775s
Received healthy response to inference request in 2.225210666656494s
Received healthy response to inference request in 1.748934030532837s
Received healthy response to inference request in 2.386321783065796s
Received healthy response to inference request in 2.2629518508911133s
Received healthy response to inference request in 1.8018856048583984s
Received healthy response to inference request in 2.977426052093506s
10 requests
0 failed requests
5th percentile: 1.7169414043426514
10th percentile: 1.7431171894073487
20th percentile: 1.7912952899932861
30th percentile: 1.8916074514389039
40th percentile: 2.1071502685546877
50th percentile: 2.2440812587738037
60th percentile: 2.3122998237609864
70th percentile: 2.4510426998138426
80th percentile: 2.624088191986084
90th percentile: 2.738730049133301
95th percentile: 2.858078050613403
99th percentile: 2.9535564517974855
mean time: 2.233782172203064
Pipeline stage StressChecker completed in 26.08s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 13.31s
Shutdown handler de-registered
function_tisif_2025-12-08 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 2852.65s
Shutdown handler de-registered
function_tisif_2025-12-08 status is now inactive due to auto deactivation removed underperforming models
function_tisif_2025-12-08 status is now torndown due to DeploymentManager action