submission_id: function_milen_2026-02-23
developer_uid: chai_backend_admin
status: inactive
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
timestamp: 2026-02-23T20:39:17+00:00
model_name: function_milen_2026-02-23
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.6847822666168213s
Received healthy response to inference request in 1.6664090156555176s
Received healthy response to inference request in 1.5916569232940674s
Received healthy response to inference request in 1.86680269241333s
Received healthy response to inference request in 2.7092552185058594s
Received healthy response to inference request in 1.6953599452972412s
Received healthy response to inference request in 1.969930648803711s
Received healthy response to inference request in 1.8289484977722168s
Received healthy response to inference request in 1.6716301441192627s
Received healthy response to inference request in 1.7162079811096191s
10 requests
0 failed requests
5th percentile: 1.6252953648567199
10th percentile: 1.6589338064193726
20th percentile: 1.6705859184265137
30th percentile: 1.6808366298675537
40th percentile: 1.6911288738250732
50th percentile: 1.7057839632034302
60th percentile: 1.7613041877746582
70th percentile: 1.8403047561645507
80th percentile: 1.8874282836914062
90th percentile: 2.0438631057739256
95th percentile: 2.3765591621398916
99th percentile: 2.642716007232666
mean time: 1.8400983333587646
Pipeline stage StressChecker completed in 20.35s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.97s
Shutdown handler de-registered
function_milen_2026-02-23 status is now deployed due to DeploymentManager action
function_milen_2026-02-23 status is now inactive due to admin request