submission_id: function_fobif_2026-03-09
developer_uid: chai_backend_admin
status: torndown
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
timestamp: 2026-03-09T03:41:10+00:00
model_name: function_fobif_2026-03-09
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 3.0616602897644043s
Received healthy response to inference request in 3.4035561084747314s
Received healthy response to inference request in 13.584466695785522s
Received healthy response to inference request in 5.8496174812316895s
Received healthy response to inference request in 9.238657236099243s
Received healthy response to inference request in 3.2779510021209717s
Received healthy response to inference request in 4.409123420715332s
Received healthy response to inference request in 2.358268976211548s
Received healthy response to inference request in 12.907301187515259s
10 requests
1 failed requests
5th percentile: 2.6747950673103333
10th percentile: 2.991321158409119
20th percentile: 3.234692859649658
30th percentile: 3.3658745765686033
40th percentile: 4.006896495819092
50th percentile: 5.129370450973511
60th percentile: 7.205233383178709
70th percentile: 10.339250421524047
80th percentile: 13.042734289169312
90th percentile: 14.425092625617978
95th percentile: 18.207909309864036
99th percentile: 21.234162657260896
mean time: 8.008132839202881
%s, retrying in %s seconds...
Received healthy response to inference request in 2.6282126903533936s
Received healthy response to inference request in 13.456069707870483s
Received healthy response to inference request in 8.237245798110962s
Received healthy response to inference request in 14.11691951751709s
Received healthy response to inference request in 14.21435832977295s
Received healthy response to inference request in 2.0177080631256104s
Received healthy response to inference request in 3.5721139907836914s
Received healthy response to inference request in 2.089700698852539s
Received healthy response to inference request in 7.462661027908325s
Received healthy response to inference request in 11.957448482513428s
10 requests
0 failed requests
5th percentile: 2.0501047492027284
10th percentile: 2.082501435279846
20th percentile: 2.5205102920532227
30th percentile: 3.288943600654602
40th percentile: 5.906442213058472
50th percentile: 7.8499534130096436
60th percentile: 9.725326871871946
70th percentile: 12.407034850120544
80th percentile: 13.588239669799805
90th percentile: 14.126663398742675
95th percentile: 14.170510864257812
99th percentile: 14.205588836669921
mean time: 7.9752438306808475
%s, retrying in %s seconds...
Received healthy response to inference request in 12.570019245147705s
Received healthy response to inference request in 7.189141035079956s
Received healthy response to inference request in 12.644867897033691s
Received healthy response to inference request in 7.322874546051025s
Received healthy response to inference request in 7.6335532665252686s
Received healthy response to inference request in 11.731495380401611s
Received healthy response to inference request in 2.113367795944214s
Received healthy response to inference request in 12.579999923706055s
Received healthy response to inference request in 7.527891159057617s
Received healthy response to inference request in 3.289898157119751s
10 requests
0 failed requests
5th percentile: 2.6428064584732054
10th percentile: 3.1722451210021974
20th percentile: 6.409292459487915
30th percentile: 7.282754492759705
40th percentile: 7.44588451385498
50th percentile: 7.580722212791443
60th percentile: 9.272730112075804
70th percentile: 11.98305253982544
80th percentile: 12.572015380859375
90th percentile: 12.586486721038819
95th percentile: 12.615677309036254
99th percentile: 12.639029779434203
mean time: 8.46031084060669
clean up pipeline due to error=DeploymentChecksError('Unacceptable 70th percentile latency 11.98305253982544s')
Shutdown handler de-registered
function_fobif_2026-03-09 status is now failed due to DeploymentManager action
function_fobif_2026-03-09 status is now torndown due to DeploymentManager action