developer_uid: chai_backend_admin
submission_id: function_kujef_2025-05-13
model_name: function_kujef_2025-05-13
model_group:
status: torndown
timestamp: 2025-05-13T17:05:53+00:00
num_battles: 8549
num_wins: 4384
celo_rating: 1295.97
family_friendly_score: 0.5446
family_friendly_standard_error: 0.0070428806606387985
submission_type: function
display_name: function_kujef_2025-05-13
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-05-13
win_ratio: 0.5128085156158615
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.248788833618164s
Received healthy response to inference request in 2.627608060836792s
Received healthy response to inference request in 2.081575632095337s
Received healthy response to inference request in 2.307669162750244s
Received healthy response to inference request in 2.9008889198303223s
5 requests
0 failed requests
5th percentile: 2.1267943382263184
10th percentile: 2.1720130443573
20th percentile: 2.2624504566192627
30th percentile: 2.3716569423675535
40th percentile: 2.4996325016021728
50th percentile: 2.627608060836792
60th percentile: 2.736920404434204
70th percentile: 2.8462327480316163
80th percentile: 2.9704689025878905
90th percentile: 3.1096288681030275
95th percentile: 3.179208850860596
99th percentile: 3.2348728370666504
mean time: 2.633306121826172
Pipeline stage StressChecker completed in 14.23s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.65s
Shutdown handler de-registered
function_kujef_2025-05-13 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3328.88s
Shutdown handler de-registered
function_kujef_2025-05-13 status is now inactive due to auto deactivation removed underperforming models
function_kujef_2025-05-13 status is now torndown due to DeploymentManager action