function_punem_2024-10-24

submission_id: function_punem_2024-10-24

developer_uid: chai_backend_admin

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

model_name: retune_with_base

status: torndown

timestamp: 2024-10-24T00:39:23+00:00

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.4037296772003174s
Received healthy response to inference request in 2.1002676486968994s
Received healthy response to inference request in 2.2249019145965576s
Received healthy response to inference request in 1.4296026229858398s
Received healthy response to inference request in 1.739495038986206s
5 requests
0 failed requests
5th percentile: 1.4089042663574218
10th percentile: 1.4140788555145263
20th percentile: 1.4244280338287354
30th percentile: 1.491581106185913
40th percentile: 1.6155380725860595
50th percentile: 1.739495038986206
60th percentile: 1.8838040828704834
70th percentile: 2.0281131267547607
80th percentile: 2.1251945018768312
90th percentile: 2.1750482082366944
95th percentile: 2.199975061416626
99th percentile: 2.2199165439605713
mean time: 1.779599380493164
Pipeline stage StressChecker completed in 11.30s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
error trigger_guanaco_pipeline args=%s error=%s
%s, retrying in %s seconds...
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
error trigger_guanaco_pipeline args=%s error=%s
%s, retrying in %s seconds...
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
error trigger_guanaco_pipeline args=%s error=%s
clean up pipeline due to error=PipelineTriggerError('{\'success\': False, \'returncode\': 2, \'stdout\': \'\', \'stderr\': "ERROR: (gcloud.run.jobs.execute) unrecognized arguments:\\n  --args=--submission_id=function_punem_2024-10-24,--pipeline=offline_family_friendly_pipeline,--timeout=60,--local (did you mean \'--async\'?)\\n  --tasks\\n  1\\n  --task-timeout\\n  63m\\n  To search the help text of gcloud commands, run:\\n  gcloud help -- SEARCH_TERMS\\n"}')
Shutdown handler de-registered
function_punem_2024-10-24 status is now failed due to DeploymentManager action
function_punem_2024-10-24 status is now torndown due to DeploymentManager action