submission_id: function_nobem_2025-07-14
developer_uid: chai_backend_admin
status: torndown
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
timestamp: 2025-07-14T18:21:16+00:00
model_name: function_nobem_2025-07-14
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.4647040367126465s
Received healthy response to inference request in 2.7254109382629395s
Received healthy response to inference request in 2.9732539653778076s
Received healthy response to inference request in 3.6059930324554443s
Received healthy response to inference request in 2.147710084915161s
5 requests
0 failed requests
5th percentile: 2.2111088752746584
10th percentile: 2.274507665634155
20th percentile: 2.4013052463531492
30th percentile: 2.5168454170227053
40th percentile: 2.6211281776428224
50th percentile: 2.7254109382629395
60th percentile: 2.8245481491088866
70th percentile: 2.923685359954834
80th percentile: 3.099801778793335
90th percentile: 3.3528974056243896
95th percentile: 3.479445219039917
99th percentile: 3.580683469772339
mean time: 2.7834144115447996
Pipeline stage StressChecker completed in 15.40s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.78s
Shutdown handler de-registered
function_nobem_2025-07-14 status is now deployed due to DeploymentManager action
function_nobem_2025-07-14 status is now inactive due to admin request
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 4868.54s
Shutdown handler de-registered
function_nobem_2025-07-14 status is now torndown due to DeploymentManager action