submission_id: r136a1-moon-l3-8b_v1
developer_uid: R136a1
status: torndown
model_repo: R136a1/Moon-L3-8B
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '<|eot_id|>'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}
formatter: {'memory_template': "<|begin_of_text|><|start_header_id|>system<|end_header_id|>\n\n{bot_name}'s Persona: {memory}\n\n", 'prompt_template': '{prompt}<|eot_id|>', 'bot_template': '<|start_header_id|>assistant<|end_header_id|>\n\n{bot_name}: {message}<|eot_id|>', 'user_template': '<|start_header_id|>user<|end_header_id|>\n\n{user_name}: {message}<|eot_id|>', 'response_template': '<|start_header_id|>assistant<|end_header_id|>\n\n{bot_name}:', 'truncate_by_message': False}
timestamp: 2024-07-11T04:56:40+00:00
model_name: r136a1-moon-l3-8b_v1
reward_repo: ChaiML/reward_gpt2_medium_preference_24m_e2
reward_formatter: {'bot_template': '{bot_name}: {message}\n', 'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'response_template': '{bot_name}:', 'truncate_by_message': False, 'user_template': '{user_name}: {message}\n'}
Resubmit model
Running pipeline stage MKMLizer
Starting job with name r136a1-moon-l3-8b-v1-mkmlizer
Waiting for job on r136a1-moon-l3-8b-v1-mkmlizer to finish
Failed to get response for submission neversleep-noromaid-v0_8068_v116: ('http://neversleep-noromaid-v0-8068-v116-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'activator request timeout')
Stopping job with name r136a1-moon-l3-8b-v1-mkmlizer
%s, retrying in %s seconds...
Starting job with name r136a1-moon-l3-8b-v1-mkmlizer
Waiting for job on r136a1-moon-l3-8b-v1-mkmlizer to finish
Stopping job with name r136a1-moon-l3-8b-v1-mkmlizer
%s, retrying in %s seconds...
Starting job with name r136a1-moon-l3-8b-v1-mkmlizer
Waiting for job on r136a1-moon-l3-8b-v1-mkmlizer to finish
Stopping job with name r136a1-moon-l3-8b-v1-mkmlizer
MKMLizerError('list index out of range')
r136a1-moon-l3-8b_v1 status is now failed due to DeploymentManager action
admin requested tearing down of r136a1-moon-l3-8b_v1
Running pipeline stage ISVCDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage ISVCDeleter completed in 0.15s
Running pipeline stage MKMLModelDeleter
Skipping deletion as no model was successfully uploaded
Pipeline stage MKMLModelDeleter completed in 0.11s
r136a1-moon-l3-8b_v1 status is now torndown due to DeploymentManager action
admin requested tearing down of r136a1-moon-l3-8b_v1
Running pipeline stage ISVCDeleter
Pipeline stage %s skipped, reason=%s
Pipeline stage ISVCDeleter completed in 0.07s
Running pipeline stage MKMLModelDeleter
Pipeline stage %s skipped, reason=%s
Pipeline stage MKMLModelDeleter completed in 0.04s
r136a1-moon-l3-8b_v1 status is now torndown due to DeploymentManager action