submission_id: function_holeb_2026-03-18
developer_uid: chai_backend_admin
status: inactive
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
timestamp: 2026-03-18T11:47:15+00:00
model_name: function_holeb_2026-03-18
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 6.149180889129639s
Received healthy response to inference request in 5.034400939941406s
Received healthy response to inference request in 3.9848270416259766s
Received healthy response to inference request in 4.34219217300415s
Received healthy response to inference request in 4.092323064804077s
Received healthy response to inference request in 3.3405351638793945s
Received healthy response to inference request in 5.437776327133179s
Received healthy response to inference request in 2.7154247760772705s
Received healthy response to inference request in 5.339222431182861s
Received healthy response to inference request in 3.462632417678833s
10 requests
0 failed requests
5th percentile: 2.9967244505882262
10th percentile: 3.278024125099182
20th percentile: 3.4382129669189454
30th percentile: 3.8281686544418334
40th percentile: 4.049324655532837
50th percentile: 4.217257618904114
60th percentile: 4.619075679779052
70th percentile: 5.125847387313843
80th percentile: 5.358933210372925
90th percentile: 5.5089167833328245
95th percentile: 5.829048836231231
99th percentile: 6.085154478549957
mean time: 4.389851522445679
Pipeline stage StressChecker completed in 45.27s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.66s
Shutdown handler de-registered
function_holeb_2026-03-18 status is now deployed due to DeploymentManager action
function_holeb_2026-03-18 status is now inactive due to admin request