submission_id: function_fujob_2026-03-10
developer_uid: chai_backend_admin
status: inactive
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
timestamp: 2026-03-10T01:38:19+00:00
model_name: function_fujob_2026-03-10
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 14.795881032943726s
Received healthy response to inference request in 3.0463368892669678s
Received healthy response to inference request in 9.415083646774292s
Received healthy response to inference request in 6.5754477977752686s
Received healthy response to inference request in 2.3882312774658203s
Received healthy response to inference request in 4.225008249282837s
Received healthy response to inference request in 5.153500556945801s
Received healthy response to inference request in 5.066263675689697s
Received healthy response to inference request in 4.051832675933838s
Received healthy response to inference request in 3.929844617843628s
10 requests
0 failed requests
5th percentile: 2.6843788027763367
10th percentile: 2.980526328086853
20th percentile: 3.753143072128296
30th percentile: 4.015236258506775
40th percentile: 4.155738019943238
50th percentile: 4.645635962486267
60th percentile: 5.1011584281921385
70th percentile: 5.580084729194641
80th percentile: 7.143374967575074
90th percentile: 9.953163385391234
95th percentile: 12.374522209167475
99th percentile: 14.311609268188477
mean time: 5.864743041992187
Pipeline stage StressChecker completed in 94.86s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 7.15s
Shutdown handler de-registered
function_fujob_2026-03-10 status is now deployed due to DeploymentManager action
function_fujob_2026-03-10 status is now inactive due to admin request