submission_id: function_namif_2025-07-10
developer_uid: chai_backend_admin
status: torndown
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
timestamp: 2025-07-10T02:44:14+00:00
model_name: function_namif_2025-07-10
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.753978967666626s
Received healthy response to inference request in 3.47861647605896s
Received healthy response to inference request in 3.5812225341796875s
Received healthy response to inference request in 3.60646653175354s
Received healthy response to inference request in 3.864426851272583s
5 requests
0 failed requests
5th percentile: 3.4991376876831053
10th percentile: 3.519658899307251
20th percentile: 3.560701322555542
30th percentile: 3.586271333694458
40th percentile: 3.596368932723999
50th percentile: 3.60646653175354
60th percentile: 3.6654715061187746
70th percentile: 3.7244764804840087
80th percentile: 3.7760685443878175
90th percentile: 3.8202476978302
95th percentile: 3.8423372745513915
99th percentile: 3.8600089359283447
mean time: 3.656942272186279
%s, retrying in %s seconds...
Received healthy response to inference request in 4.286029100418091s
Received healthy response to inference request in 3.561458110809326s
Received healthy response to inference request in 4.23811674118042s
Received healthy response to inference request in 3.390467405319214s
Received healthy response to inference request in 2.8508336544036865s
5 requests
0 failed requests
5th percentile: 2.958760404586792
10th percentile: 3.0666871547698973
20th percentile: 3.2825406551361085
30th percentile: 3.4246655464172364
40th percentile: 3.493061828613281
50th percentile: 3.561458110809326
60th percentile: 3.832121562957764
70th percentile: 4.102785015106201
80th percentile: 4.247699213027954
90th percentile: 4.266864156723022
95th percentile: 4.2764466285705565
99th percentile: 4.284112606048584
mean time: 3.6653810024261473
%s, retrying in %s seconds...
Received healthy response to inference request in 4.699146032333374s
Received healthy response to inference request in 3.671433210372925s
Received healthy response to inference request in 2.513878583908081s
Received healthy response to inference request in 3.088651657104492s
Received healthy response to inference request in 2.7076385021209717s
5 requests
0 failed requests
5th percentile: 2.552630567550659
10th percentile: 2.591382551193237
20th percentile: 2.6688865184783936
30th percentile: 2.783841133117676
40th percentile: 2.936246395111084
50th percentile: 3.088651657104492
60th percentile: 3.321764278411865
70th percentile: 3.5548768997192384
80th percentile: 3.8769757747650146
90th percentile: 4.288060903549194
95th percentile: 4.493603467941284
99th percentile: 4.658037519454956
mean time: 3.3361495971679687
Pipeline stage StressChecker completed in 65.65s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.65s
Shutdown handler de-registered
function_namif_2025-07-10 status is now deployed due to DeploymentManager action
function_namif_2025-07-10 status is now inactive due to admin request
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 4330.01s
Shutdown handler de-registered
function_namif_2025-07-10 status is now torndown due to DeploymentManager action