submission_id: function_dusas_2025-05-20
developer_uid: chai_backend_admin
status: failed
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
timestamp: 2025-05-20T21:02:33+00:00
model_name: function_dusas_2025-05-20
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 13.205053806304932s
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
5 requests
4 failed requests
5th percentile: 14.58752989768982
10th percentile: 15.970005989074707
20th percentile: 18.734958171844482
30th percentile: 20.119040298461915
40th percentile: 20.122252368927
50th percentile: 20.12546443939209
60th percentile: 20.133952713012697
70th percentile: 20.1424409866333
80th percentile: 20.178265619277955
90th percentile: 20.241426610946654
95th percentile: 20.273007106781005
99th percentile: 20.298271503448486
mean time: 18.77984504699707
%s, retrying in %s seconds...
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 19.24012327194214s
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 6.638321399688721s
5 requests
3 failed requests
5th percentile: 9.158681774139405
10th percentile: 11.679042148590089
20th percentile: 16.719762897491456
30th percentile: 19.417199039459227
40th percentile: 19.771350574493407
50th percentile: 20.125502109527588
60th percentile: 20.127696418762206
70th percentile: 20.129890727996827
80th percentile: 20.13446717262268
90th percentile: 20.14142575263977
95th percentile: 20.144905042648315
99th percentile: 20.14768847465515
mean time: 17.25666379928589
%s, retrying in %s seconds...
Received healthy response to inference request in 5.924649238586426s
Received healthy response to inference request in 16.77619957923889s
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 6.34114146232605s
Received healthy response to inference request in 5.758342266082764s
5 requests
1 failed requests
5th percentile: 5.791603660583496
10th percentile: 5.824865055084229
20th percentile: 5.891387844085694
30th percentile: 6.007947683334351
40th percentile: 6.1745445728302
50th percentile: 6.34114146232605
60th percentile: 10.515164709091184
70th percentile: 14.68918795585632
80th percentile: 17.450899267196657
90th percentile: 18.800298643112182
95th percentile: 19.474998331069944
99th percentile: 20.014758081436156
mean time: 10.990006113052369
clean up pipeline due to error=DeploymentChecksError('Unacceptable number of predict errors: 20.0%')
Shutdown handler de-registered
function_dusas_2025-05-20 status is now failed due to DeploymentManager action