submission_id: function_bufin_2026-03-08
developer_uid: chai_backend_admin
status: inactive
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
timestamp: 2026-03-08T23:16:26+00:00
model_name: function_bufin_2026-03-08
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.8210370540618896s
Received healthy response to inference request in 3.066986083984375s
Received healthy response to inference request in 2.928654909133911s
Received healthy response to inference request in 3.537393093109131s
Received healthy response to inference request in 2.9310905933380127s
Received healthy response to inference request in 3.1013455390930176s
Received healthy response to inference request in 3.333494186401367s
Received healthy response to inference request in 2.9210057258605957s
Received healthy response to inference request in 3.2350945472717285s
Received healthy response to inference request in 3.190267562866211s
10 requests
0 failed requests
5th percentile: 2.9244478583335876
10th percentile: 2.9278899908065794
20th percentile: 2.9306034564971926
30th percentile: 3.0262174367904664
40th percentile: 3.0876017570495606
50th percentile: 3.1458065509796143
60th percentile: 3.208198356628418
70th percentile: 3.26461443901062
80th percentile: 3.37427396774292
90th percentile: 3.565757489204407
95th percentile: 3.693397271633148
99th percentile: 3.7955090975761414
mean time: 3.206636929512024
Pipeline stage StressChecker completed in 67.27s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 4.85s
Shutdown handler de-registered
function_bufin_2026-03-08 status is now deployed due to DeploymentManager action
function_bufin_2026-03-08 status is now inactive due to admin request