submission_id: function_difok_2026-02-25
developer_uid: chai_backend_admin
status: inactive
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
timestamp: 2026-02-25T21:08:58+00:00
model_name: function_difok_2026-02-25
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.570969581604004s
Received healthy response to inference request in 3.640103340148926s
Received healthy response to inference request in 5.245802879333496s
Received healthy response to inference request in 4.886018991470337s
Received healthy response to inference request in 4.090737819671631s
Received healthy response to inference request in 3.5133728981018066s
Received healthy response to inference request in 3.217205286026001s
Received healthy response to inference request in 3.0900261402130127s
Received healthy response to inference request in 5.390404224395752s
Received healthy response to inference request in 6.211352348327637s
10 requests
0 failed requests
5th percentile: 3.1472567558288573
10th percentile: 3.204487371444702
20th percentile: 3.4541393756866454
30th percentile: 3.60208420753479
40th percentile: 3.910484027862549
50th percentile: 4.330853700637817
60th percentile: 4.696989345550537
70th percentile: 4.993954157829284
80th percentile: 5.274723148345947
90th percentile: 5.47249903678894
95th percentile: 5.841925692558288
99th percentile: 6.137467017173767
mean time: 4.38559935092926
Pipeline stage StressChecker completed in 45.91s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.59s
Shutdown handler de-registered
function_difok_2026-02-25 status is now deployed due to DeploymentManager action
function_difok_2026-02-25 status is now inactive due to admin request