submission_id: function_fohof_2025-07-27
developer_uid: chai_backend_admin
status: torndown
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
timestamp: 2025-07-27T07:46:19+00:00
model_name: function_fohof_2025-07-27
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.8475232124328613s
Received healthy response to inference request in 3.464695930480957s
Received healthy response to inference request in 3.2707834243774414s
Received healthy response to inference request in 2.4026734828948975s
Received healthy response to inference request in 2.2350056171417236s
5 requests
0 failed requests
5th percentile: 2.2685391902923584
10th percentile: 2.302072763442993
20th percentile: 2.3691399097442627
30th percentile: 2.4916434288024902
40th percentile: 2.669583320617676
50th percentile: 2.8475232124328613
60th percentile: 3.0168272972106935
70th percentile: 3.1861313819885253
80th percentile: 3.3095659255981444
90th percentile: 3.387130928039551
95th percentile: 3.425913429260254
99th percentile: 3.4569394302368166
mean time: 2.8441363334655763
Pipeline stage StressChecker completed in 15.45s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.67s
Shutdown handler de-registered
function_fohof_2025-07-27 status is now deployed due to DeploymentManager action
function_fohof_2025-07-27 status is now inactive due to admin request
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3576.76s
Shutdown handler de-registered
function_fohof_2025-07-27 status is now torndown due to DeploymentManager action