submission_id: function_difam_2025-07-27
developer_uid: chai_backend_admin
status: torndown
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
timestamp: 2025-07-27T07:39:26+00:00
model_name: function_difam_2025-07-27
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.7680938243865967s
Received healthy response to inference request in 1.9451017379760742s
Received healthy response to inference request in 2.5028178691864014s
Received healthy response to inference request in 3.18735671043396s
Received healthy response to inference request in 3.0083048343658447s
5 requests
0 failed requests
5th percentile: 2.0566449642181395
10th percentile: 2.168188190460205
20th percentile: 2.391274642944336
30th percentile: 2.5558730602264403
40th percentile: 2.6619834423065187
50th percentile: 2.7680938243865967
60th percentile: 2.8641782283782957
70th percentile: 2.960262632369995
80th percentile: 3.0441152095794677
90th percentile: 3.115735960006714
95th percentile: 3.151546335220337
99th percentile: 3.1801946353912354
mean time: 2.6823349952697755
Pipeline stage StressChecker completed in 14.83s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.69s
Shutdown handler de-registered
function_difam_2025-07-27 status is now deployed due to DeploymentManager action
function_difam_2025-07-27 status is now inactive due to admin request
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3691.30s
Shutdown handler de-registered
function_difam_2025-07-27 status is now torndown due to DeploymentManager action