submission_id: failspy-llama-3-70b-inst_8684_v2
developer_uid: windyheath
status: torndown
model_repo: failspy/llama-3-70B-Instruct-abliterated
generation_params: {'temperature': 1.1, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 1.1, 'stopping_words': ['\n'], 'max_input_tokens': 512, 'best_of': 4, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
timestamp: 2024-06-09T17:27:37+00:00
model_name: failspy-llama-3-70b-inst_8684_v2
reward_formatter: {'bot_template': '{bot_name}: {message}\n', 'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'response_template': '{bot_name}:', 'truncate_by_message': False, 'user_template': '{user_name}: {message}\n'}
reward_repo: ChaiML/reward_gpt2_medium_preference_24m_e2
Resubmit model
Running pipeline stage MKMLizer
Starting job with name failspy-llama-3-70b-inst-8684-v2-mkmlizer
Waiting for job on failspy-llama-3-70b-inst-8684-v2-mkmlizer to finish
Stopping job with name failspy-llama-3-70b-inst-8684-v2-mkmlizer
%s, retrying in %s seconds...
Starting job with name failspy-llama-3-70b-inst-8684-v2-mkmlizer
Waiting for job on failspy-llama-3-70b-inst-8684-v2-mkmlizer to finish
Stopping job with name failspy-llama-3-70b-inst-8684-v2-mkmlizer
%s, retrying in %s seconds...
Starting job with name failspy-llama-3-70b-inst-8684-v2-mkmlizer
Waiting for job on failspy-llama-3-70b-inst-8684-v2-mkmlizer to finish
Stopping job with name failspy-llama-3-70b-inst-8684-v2-mkmlizer
MKMLizerError('list index out of range')
failspy-llama-3-70b-inst_8684_v2 status is now failed due to DeploymentManager action
admin requested tearing down of failspy-llama-3-70b-inst_8684_v2
Running pipeline stage ISVCDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage ISVCDeleter completed in 0.10s
Running pipeline stage MKMLModelDeleter
Skipping deletion as no model was successfully uploaded
Pipeline stage MKMLModelDeleter completed in 0.08s
failspy-llama-3-70b-inst_8684_v2 status is now torndown due to DeploymentManager action