developer_uid: chai_backend_admin
submission_id: function_lanek_2025-05-01
model_name: function_lanek_2025-05-01
model_group:
status: torndown
timestamp: 2025-05-01T22:26:45+00:00
num_battles: 9898
num_wins: 4994
celo_rating: 1288.06
family_friendly_score: 0.5322
family_friendly_standard_error: 0.007056389445034904
submission_type: function
display_name: function_lanek_2025-05-01
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-05-01
win_ratio: 0.5045463730046474
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.98686146736145s
Received healthy response to inference request in 3.106090545654297s
Received healthy response to inference request in 3.4580020904541016s
Received healthy response to inference request in 3.9962239265441895s
Received healthy response to inference request in 3.2591826915740967s
5 requests
0 failed requests
5th percentile: 3.136708974838257
10th percentile: 3.167327404022217
20th percentile: 3.2285642623901367
30th percentile: 3.298946571350098
40th percentile: 3.3784743309020997
50th percentile: 3.4580020904541016
60th percentile: 3.669545841217041
70th percentile: 3.8810895919799804
80th percentile: 3.9887339591979982
90th percentile: 3.992478942871094
95th percentile: 3.9943514347076414
99th percentile: 3.99584942817688
mean time: 3.561272144317627
%s, retrying in %s seconds...
Received healthy response to inference request in 3.6316869258880615s
Received healthy response to inference request in 3.8451578617095947s
Received healthy response to inference request in 3.306832790374756s
Received healthy response to inference request in 4.2809460163116455s
Received healthy response to inference request in 4.02020525932312s
5 requests
0 failed requests
5th percentile: 3.371803617477417
10th percentile: 3.4367744445800783
20th percentile: 3.5667160987854003
30th percentile: 3.6743811130523683
40th percentile: 3.7597694873809813
50th percentile: 3.8451578617095947
60th percentile: 3.915176820755005
70th percentile: 3.985195779800415
80th percentile: 4.072353410720825
90th percentile: 4.176649713516236
95th percentile: 4.228797864913941
99th percentile: 4.270516386032105
mean time: 3.8169657707214357
%s, retrying in %s seconds...
Received healthy response to inference request in 3.3774850368499756s
Received healthy response to inference request in 3.5562493801116943s
Received healthy response to inference request in 3.768126964569092s
Received healthy response to inference request in 3.339759111404419s
Received healthy response to inference request in 2.3660905361175537s
5 requests
0 failed requests
5th percentile: 2.560824251174927
10th percentile: 2.7555579662323
20th percentile: 3.145025396347046
30th percentile: 3.3473042964935305
40th percentile: 3.362394666671753
50th percentile: 3.3774850368499756
60th percentile: 3.4489907741546633
70th percentile: 3.5204965114593505
80th percentile: 3.598624897003174
90th percentile: 3.683375930786133
95th percentile: 3.725751447677612
99th percentile: 3.759651861190796
mean time: 3.281542205810547
Pipeline stage StressChecker completed in 56.68s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.64s
Shutdown handler de-registered
function_lanek_2025-05-01 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3106.00s
Shutdown handler de-registered
function_lanek_2025-05-01 status is now inactive due to auto deactivation removed underperforming models
function_lanek_2025-05-01 status is now torndown due to DeploymentManager action