mattshumer-reflection-ll_5128

submission_id: mattshumer-reflection-ll_5128_v2
developer_uid: Meliodia
formatter: {'memory_template': '<|im_start|>system\n{memory}<|im_end|>\n', 'prompt_template': '<|im_start|>user\n{prompt}<|im_end|>\n', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{user_name}: {message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 512, 'best_of': 1, 'max_output_tokens': 64}
model_name: mattshumer-reflection-ll_5128_v2
model_repo: mattshumer/Reflection-Llama-3.1-70B
status: torndown
timestamp: 2024-09-16T18:38:08+00:00
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name mattshumer-reflection-ll-5128-v2-mkmlizer
Waiting for job on mattshumer-reflection-ll-5128-v2-mkmlizer to finish
mattshumer-reflection-ll-5128-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
mattshumer-reflection-ll-5128-v2-mkmlizer: ║     _____            __           __                                ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║       /___/                                                         ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║                                                                     ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║  Version: 0.10.1                                                    ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║  https://mk1.ai                                                     ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║                                                                     ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║  The license key for the current software has been verified as      ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║  belonging to:                                                      ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║                                                                     ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║  Chai Research Corp.                                                ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║                                                                     ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Failed to get response for submission blend_hokok_2024-09-09: ('http://neversleep-noromaid-v0-8068-v150-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Failed to get response for submission blend_hokok_2024-09-09: ('http://neversleep-noromaid-v0-8068-v150-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Stopping job with name mattshumer-reflection-ll-5128-v2-mkmlizer
Retrying (%r) after connection broken by '%r': %s
%s, retrying in %s seconds...
Starting job with name mattshumer-reflection-ll-5128-v2-mkmlizer
Waiting for job on mattshumer-reflection-ll-5128-v2-mkmlizer to finish
Failed to get response for submission blend_hokok_2024-09-09: ('http://neversleep-noromaid-v0-8068-v150-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
mattshumer-reflection-ll-5128-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
mattshumer-reflection-ll-5128-v2-mkmlizer: ║     _____            __           __                                ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║       /___/                                                         ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║                                                                     ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║  Version: 0.10.1                                                    ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║  https://mk1.ai                                                     ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║                                                                     ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║  The license key for the current software has been verified as      ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║  belonging to:                                                      ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║                                                                     ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║  Chai Research Corp.                                                ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ║                                                                     ║
mattshumer-reflection-ll-5128-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
Stopping job with name mattshumer-reflection-ll-5128-v2-mkmlizer
%s, retrying in %s seconds...
Starting job with name mattshumer-reflection-ll-5128-v2-mkmlizer
Waiting for job on mattshumer-reflection-ll-5128-v2-mkmlizer to finish
Failed to get response for submission blend_hokok_2024-09-09: ('http://neversleep-noromaid-v0-8068-v150-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Stopping job with name mattshumer-reflection-ll-5128-v2-mkmlizer
%s, retrying in %s seconds...
Stopping job with name mattshumer-reflection-ll-5128-v2-mkmlizer
clean up pipeline due to error=%s
Shutdown handler de-registered
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
mattshumer-reflection-ll_5128_v2 status is now failed due to DeploymentManager action
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
mattshumer-reflection-ll_5128_v2 status is now torndown due to DeploymentManager action