submission_id: function_budaf_2025-08-10
developer_uid: chai_backend_admin
status: failed
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
timestamp: 2025-08-10T00:16:25+00:00
model_name: function_budaf_2025-08-10
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.1155641078948975s
Received healthy response to inference request in 2.333564043045044s
Received healthy response to inference request in 4.679593801498413s
Received healthy response to inference request in 3.5633249282836914s
Received healthy response to inference request in 4.997686386108398s
5 requests
0 failed requests
5th percentile: 2.4899640560150145
10th percentile: 2.6463640689849854
20th percentile: 2.959164094924927
30th percentile: 3.2051162719726562
40th percentile: 3.384220600128174
50th percentile: 3.5633249282836914
60th percentile: 4.00983247756958
70th percentile: 4.456340026855469
80th percentile: 4.74321231842041
90th percentile: 4.870449352264404
95th percentile: 4.934067869186402
99th percentile: 4.9849626827239994
mean time: 3.737946653366089
%s, retrying in %s seconds...
Received healthy response to inference request in 3.6799283027648926s
Received healthy response to inference request in 4.122362375259399s
Received healthy response to inference request in 4.96795392036438s
Received healthy response to inference request in 2.1447091102600098s
Received healthy response to inference request in 3.4535984992980957s
5 requests
0 failed requests
5th percentile: 2.406486988067627
10th percentile: 2.668264865875244
20th percentile: 3.1918206214904785
30th percentile: 3.498864459991455
40th percentile: 3.5893963813781737
50th percentile: 3.6799283027648926
60th percentile: 3.856901931762695
70th percentile: 4.033875560760498
80th percentile: 4.291480684280396
90th percentile: 4.629717302322388
95th percentile: 4.798835611343383
99th percentile: 4.934130258560181
mean time: 3.6737104415893556
%s, retrying in %s seconds...
Received healthy response to inference request in 2.9088544845581055s
Received healthy response to inference request in 3.267974615097046s
Received healthy response to inference request in 3.285003423690796s
Received healthy response to inference request in 3.9882853031158447s
Received healthy response to inference request in 4.687750816345215s
5 requests
0 failed requests
5th percentile: 2.9806785106658937
10th percentile: 3.0525025367736816
20th percentile: 3.1961505889892576
30th percentile: 3.271380376815796
40th percentile: 3.278191900253296
50th percentile: 3.285003423690796
60th percentile: 3.5663161754608153
70th percentile: 3.8476289272308346
80th percentile: 4.128178405761719
90th percentile: 4.407964611053467
95th percentile: 4.547857713699341
99th percentile: 4.65977219581604
mean time: 3.6275737285614014
clean up pipeline due to error=DeploymentChecksError('Unacceptable 70th percentile latency 3.8476289272308346s')
Shutdown handler de-registered
function_budaf_2025-08-10 status is now failed due to DeploymentManager action