submission_id: function_hileb_2025-07-10
developer_uid: chai_backend_admin
status: torndown
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
timestamp: 2025-07-10T04:43:06+00:00
model_name: function_hileb_2025-07-10
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.0216376781463623s
Received healthy response to inference request in 3.171272039413452s
Received healthy response to inference request in 4.2029101848602295s
Received healthy response to inference request in 2.769320249557495s
Received healthy response to inference request in 3.0619468688964844s
5 requests
0 failed requests
5th percentile: 2.171174192428589
10th percentile: 2.3207107067108153
20th percentile: 2.6197837352752686
30th percentile: 2.827845573425293
40th percentile: 2.9448962211608887
50th percentile: 3.0619468688964844
60th percentile: 3.1056769371032713
70th percentile: 3.1494070053100587
80th percentile: 3.377599668502808
90th percentile: 3.7902549266815186
95th percentile: 3.996582555770874
99th percentile: 4.161644659042358
mean time: 3.0454174041748048
Pipeline stage StressChecker completed in 16.82s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.79s
Shutdown handler de-registered
function_hileb_2025-07-10 status is now deployed due to DeploymentManager action
function_hileb_2025-07-10 status is now inactive due to admin request
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3253.34s
Shutdown handler de-registered
function_hileb_2025-07-10 status is now torndown due to DeploymentManager action