developer_uid: chai_backend_admin
submission_id: function_delor_2025-07-07
model_name: function_delor_2025-07-07
model_group:
status: torndown
timestamp: 2025-07-07T21:49:05+00:00
num_battles: 6991
num_wins: 3568
celo_rating: 1298.46
family_friendly_score: 0.5307999999999999
family_friendly_standard_error: 0.007057639265363454
submission_type: function
display_name: function_delor_2025-07-07
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-07-07
win_ratio: 0.5103704763267057
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.6540720462799072s
Received healthy response to inference request in 3.7370765209198s
Received healthy response to inference request in 5.424900531768799s
Received healthy response to inference request in 4.593306541442871s
Received healthy response to inference request in 2.6332733631134033s
5 requests
0 failed requests
5th percentile: 2.837433099746704
10th percentile: 3.041592836380005
20th percentile: 3.4499123096466064
30th percentile: 3.6706729412078856
40th percentile: 3.7038747310638427
50th percentile: 3.7370765209198
60th percentile: 4.079568529129029
70th percentile: 4.422060537338257
80th percentile: 4.759625339508057
90th percentile: 5.092262935638428
95th percentile: 5.258581733703613
99th percentile: 5.391636772155762
mean time: 4.008525800704956
%s, retrying in %s seconds...
Received healthy response to inference request in 4.566729307174683s
Received healthy response to inference request in 1.844109058380127s
Received healthy response to inference request in 1.8437552452087402s
Received healthy response to inference request in 2.861767292022705s
Received healthy response to inference request in 4.008012056350708s
5 requests
0 failed requests
5th percentile: 1.8438260078430175
10th percentile: 1.8438967704772948
20th percentile: 1.8440382957458497
30th percentile: 2.0476407051086425
40th percentile: 2.454703998565674
50th percentile: 2.861767292022705
60th percentile: 3.320265197753906
70th percentile: 3.7787631034851072
80th percentile: 4.119755506515503
90th percentile: 4.343242406845093
95th percentile: 4.454985857009888
99th percentile: 4.544380617141724
mean time: 3.0248745918273925
%s, retrying in %s seconds...
Received healthy response to inference request in 3.2132623195648193s
Received healthy response to inference request in 5.002669334411621s
Received healthy response to inference request in 2.4226644039154053s
Received healthy response to inference request in 3.046933889389038s
Received healthy response to inference request in 2.090381383895874s
5 requests
0 failed requests
5th percentile: 2.15683798789978
10th percentile: 2.2232945919036866
20th percentile: 2.356207799911499
30th percentile: 2.5475183010101317
40th percentile: 2.797226095199585
50th percentile: 3.046933889389038
60th percentile: 3.1134652614593508
70th percentile: 3.179996633529663
80th percentile: 3.57114372253418
90th percentile: 4.2869065284729
95th percentile: 4.64478793144226
99th percentile: 4.931093053817749
mean time: 3.1551822662353515
Pipeline stage StressChecker completed in 55.58s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.95s
Shutdown handler de-registered
function_delor_2025-07-07 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 7229.89s
Shutdown handler de-registered
function_delor_2025-07-07 status is now inactive due to auto deactivation removed underperforming models
function_delor_2025-07-07 status is now torndown due to DeploymentManager action