submission_id: steelskull-l3-aethora-15b_v4
developer_uid: windyheath
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.1, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 1.1, 'stopping_words': ['\n'], 'max_input_tokens': 512, 'best_of': 4, 'max_output_tokens': 64}
model_name: steelskull-l3-aethora-15b_v4
model_repo: Steelskull/L3-Aethora-15B
reward_formatter: {'bot_template': '{bot_name}: {message}\n', 'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'response_template': '{bot_name}:', 'truncate_by_message': False, 'user_template': '{user_name}: {message}\n'}
reward_repo: ChaiML/reward_gpt2_medium_preference_24m_e2
status: torndown
timestamp: 2024-06-09T17:20:12+00:00
Resubmit model
Running pipeline stage MKMLizer
Starting job with name steelskull-l3-aethora-15b-v4-mkmlizer
Waiting for job on steelskull-l3-aethora-15b-v4-mkmlizer to finish
Stopping job with name steelskull-l3-aethora-15b-v4-mkmlizer
%s, retrying in %s seconds...
Starting job with name steelskull-l3-aethora-15b-v4-mkmlizer
Waiting for job on steelskull-l3-aethora-15b-v4-mkmlizer to finish
Stopping job with name steelskull-l3-aethora-15b-v4-mkmlizer
%s, retrying in %s seconds...
Starting job with name steelskull-l3-aethora-15b-v4-mkmlizer
Waiting for job on steelskull-l3-aethora-15b-v4-mkmlizer to finish
Stopping job with name steelskull-l3-aethora-15b-v4-mkmlizer
MKMLizerError('list index out of range')
steelskull-l3-aethora-15b_v4 status is now failed due to DeploymentManager action
admin requested tearing down of steelskull-l3-aethora-15b_v4
Running pipeline stage ISVCDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage ISVCDeleter completed in 0.11s
Running pipeline stage MKMLModelDeleter
Skipping deletion as no model was successfully uploaded
Pipeline stage MKMLModelDeleter completed in 0.08s
steelskull-l3-aethora-15b_v4 status is now torndown due to DeploymentManager action

Usage Metrics

Latency Metrics