submission_id: function_fadef_2026-03-09
developer_uid: chai_backend_admin
status: inactive
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
timestamp: 2026-03-09T20:04:15+00:00
model_name: function_fadef_2026-03-09
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 5.783782005310059s
Received healthy response to inference request in 3.717151403427124s
Received healthy response to inference request in 4.124146461486816s
Received healthy response to inference request in 6.107917547225952s
Received healthy response to inference request in 4.200025796890259s
Received healthy response to inference request in 5.069928169250488s
Received healthy response to inference request in 8.388274669647217s
Received healthy response to inference request in 4.626436233520508s
Received healthy response to inference request in 5.688886642456055s
Received healthy response to inference request in 6.336279392242432s
10 requests
0 failed requests
5th percentile: 3.9002991795539854
10th percentile: 4.083446955680847
20th percentile: 4.1848499298095705
30th percentile: 4.498513102531433
40th percentile: 4.892531394958496
50th percentile: 5.3794074058532715
60th percentile: 5.726844787597656
70th percentile: 5.881022667884826
80th percentile: 6.153589916229248
90th percentile: 6.541478919982909
95th percentile: 7.464876794815061
99th percentile: 8.203595094680786
mean time: 5.404282832145691
Pipeline stage StressChecker completed in 67.24s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.81s
Shutdown handler de-registered
function_fadef_2026-03-09 status is now deployed due to DeploymentManager action
function_fadef_2026-03-09 status is now inactive due to admin request