submission_id: function_surum_2024-10-24
developer_uid: chai_backend_admin
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
model_name: retune_with_base
status: torndown
timestamp: 2024-10-24T00:38:12+00:00
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.552307367324829s
Received healthy response to inference request in 1.4999337196350098s
Received healthy response to inference request in 1.6142210960388184s
Received healthy response to inference request in 1.5655171871185303s
Received healthy response to inference request in 1.8486239910125732s
5 requests
0 failed requests
5th percentile: 1.5104084491729737
10th percentile: 1.5208831787109376
20th percentile: 1.5418326377868652
30th percentile: 1.5549493312835694
40th percentile: 1.5602332592010497
50th percentile: 1.5655171871185303
60th percentile: 1.5849987506866454
70th percentile: 1.6044803142547608
80th percentile: 1.6611016750335694
90th percentile: 1.7548628330230713
95th percentile: 1.8017434120178222
99th percentile: 1.839247875213623
mean time: 1.6161206722259522
Pipeline stage StressChecker completed in 10.55s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
error trigger_guanaco_pipeline args=%s error=%s
%s, retrying in %s seconds...
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
error trigger_guanaco_pipeline args=%s error=%s
%s, retrying in %s seconds...
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
error trigger_guanaco_pipeline args=%s error=%s
clean up pipeline due to error=PipelineTriggerError('{\'success\': False, \'returncode\': 2, \'stdout\': \'\', \'stderr\': "ERROR: (gcloud.run.jobs.execute) unrecognized arguments:\\n  --args=--submission_id=function_surum_2024-10-24,--pipeline=offline_family_friendly_pipeline,--timeout=60,--local (did you mean \'--async\'?)\\n  --tasks\\n  1\\n  --task-timeout\\n  63m\\n  To search the help text of gcloud commands, run:\\n  gcloud help -- SEARCH_TERMS\\n"}')
Shutdown handler de-registered
function_surum_2024-10-24 status is now failed due to DeploymentManager action
function_surum_2024-10-24 status is now torndown due to DeploymentManager action