submission_id: function_bolim_2025-07-14
developer_uid: chai_backend_admin
status: torndown
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
timestamp: 2025-07-14T18:27:25+00:00
model_name: function_bolim_2025-07-14
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.267099618911743s
Received healthy response to inference request in 2.833491563796997s
Received healthy response to inference request in 2.1701462268829346s
Received healthy response to inference request in 3.2744998931884766s
Received healthy response to inference request in 3.64681339263916s
5 requests
0 failed requests
5th percentile: 2.1895369052886964
10th percentile: 2.208927583694458
20th percentile: 2.2477089405059814
30th percentile: 2.380378007888794
40th percentile: 2.6069347858428955
50th percentile: 2.833491563796997
60th percentile: 3.0098948955535887
70th percentile: 3.1862982273101808
80th percentile: 3.3489625930786135
90th percentile: 3.4978879928588866
95th percentile: 3.572350692749023
99th percentile: 3.631920852661133
mean time: 2.8384101390838623
Pipeline stage StressChecker completed in 15.95s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.61s
Shutdown handler de-registered
function_bolim_2025-07-14 status is now deployed due to DeploymentManager action
function_bolim_2025-07-14 status is now inactive due to admin request
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 5218.35s
Shutdown handler de-registered
function_bolim_2025-07-14 status is now torndown due to DeploymentManager action