submission_id: function_futit_2026-03-10
developer_uid: chai_backend_admin
status: inactive
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
timestamp: 2026-03-10T01:34:07+00:00
model_name: function_futit_2026-03-10
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 9.2956063747406s
Received healthy response to inference request in 3.1973626613616943s
Received healthy response to inference request in 3.0585174560546875s
Received healthy response to inference request in 3.4369027614593506s
Received healthy response to inference request in 17.186522006988525s
Received healthy response to inference request in 3.431013822555542s
Received healthy response to inference request in 3.6821625232696533s
Received healthy response to inference request in 5.7758166790008545s
Received healthy response to inference request in 4.702517986297607s
Received healthy response to inference request in 4.020572900772095s
10 requests
0 failed requests
5th percentile: 3.1209977984428408
10th percentile: 3.1834781408309936
20th percentile: 3.3842835903167723
30th percentile: 3.435136079788208
40th percentile: 3.5840586185455323
50th percentile: 3.851367712020874
60th percentile: 4.2933509349823
70th percentile: 5.024507594108582
80th percentile: 6.479774618148804
90th percentile: 10.084697937965391
95th percentile: 13.635609972476951
99th percentile: 16.476339600086213
mean time: 5.778699517250061
Pipeline stage StressChecker completed in 93.67s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 5.09s
Shutdown handler de-registered
function_futit_2026-03-10 status is now deployed due to DeploymentManager action
function_futit_2026-03-10 status is now inactive due to admin request