chaser-cz-share-qlora-out

developer_uid: chace9580
submission_id: chaser-cz-share-qlora-out_v5
model_name: chaser-cz-share-qlora-out_v5
model_group: Chaser-cz/share-qlora-ou
status: torndown
timestamp: 2024-07-21T05:33:33+00:00
num_battles: 13277
num_wins: 6424
celo_rating: 1179.89
family_friendly_score: 0.0
submission_type: basic
model_repo: Chaser-cz/share-qlora-out
model_architecture: MistralForCausalLM
reward_repo: ChaiML/reward_gpt2_medium_preference_24m_e2
model_num_parameters: 7241732096.0
best_of: 16
max_input_tokens: 512
max_output_tokens: 64
display_name: chaser-cz-share-qlora-out_v5
is_internal_developer: False
language_model: Chaser-cz/share-qlora-out
model_size: 7B
ranking_group: single
us_pacific_date: 2024-07-20
win_ratio: 0.48384424192212094
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
reward_formatter: {'bot_template': '{bot_name}: {message}\n', 'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'response_template': '{bot_name}:', 'truncate_by_message': False, 'user_template': '{user_name}: {message}\n'}
Resubmit model
Running pipeline stage MKMLizer
Starting job with name chaser-cz-share-qlora-out-v5-mkmlizer
Waiting for job on chaser-cz-share-qlora-out-v5-mkmlizer to finish
chaser-cz-share-qlora-out-v5-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaser-cz-share-qlora-out-v5-mkmlizer: ║     _____            __           __                                ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║       /___/                                                         ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║                                                                     ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║  Version: 0.9.5.post3                                               ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║  https://mk1.ai                                                     ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║                                                                     ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║  The license key for the current software has been verified as      ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║  belonging to:                                                      ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║                                                                     ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║  Chai Research Corp.                                                ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║                                                                     ║
chaser-cz-share-qlora-out-v5-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaser-cz-share-qlora-out-v5-mkmlizer: Downloaded to shared memory in 27.201s
chaser-cz-share-qlora-out-v5-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpoapstfhp, device:0
chaser-cz-share-qlora-out-v5-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaser-cz-share-qlora-out-v5-mkmlizer: quantized model in 14.053s
chaser-cz-share-qlora-out-v5-mkmlizer: Processed model Chaser-cz/share-qlora-out in 41.254s
chaser-cz-share-qlora-out-v5-mkmlizer: creating bucket guanaco-mkml-models
chaser-cz-share-qlora-out-v5-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaser-cz-share-qlora-out-v5-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaser-cz-share-qlora-out-v5
chaser-cz-share-qlora-out-v5-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaser-cz-share-qlora-out-v5/config.json
chaser-cz-share-qlora-out-v5-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaser-cz-share-qlora-out-v5/tokenizer_config.json
chaser-cz-share-qlora-out-v5-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaser-cz-share-qlora-out-v5/special_tokens_map.json
chaser-cz-share-qlora-out-v5-mkmlizer: cp /dev/shm/model_cache/tokenizer.model s3://guanaco-mkml-models/chaser-cz-share-qlora-out-v5/tokenizer.model
chaser-cz-share-qlora-out-v5-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaser-cz-share-qlora-out-v5/tokenizer.json
chaser-cz-share-qlora-out-v5-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaser-cz-share-qlora-out-v5/flywheel_model.0.safetensors
chaser-cz-share-qlora-out-v5-mkmlizer: loading reward model from ChaiML/reward_gpt2_medium_preference_24m_e2
chaser-cz-share-qlora-out-v5-mkmlizer: 
Loading 0:   0%|          | 0/291 [00:00<?, ?it/s]
Loading 0:  34%|███▎      | 98/291 [00:01<00:02, 90.87it/s]
Loading 0:  70%|███████   | 204/291 [00:02<00:00, 101.24it/s]
Loading 0: 100%|██████████| 291/291 [00:03<00:00, 82.33it/s] 
                                                            
/opt/conda/lib/python3.10/site-packages/transformers/models/auto/configuration_auto.py:950: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
chaser-cz-share-qlora-out-v5-mkmlizer:   warnings.warn(
chaser-cz-share-qlora-out-v5-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py:469: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
chaser-cz-share-qlora-out-v5-mkmlizer:   warnings.warn(
chaser-cz-share-qlora-out-v5-mkmlizer: Saving model to /tmp/reward_cache/reward.tensors
chaser-cz-share-qlora-out-v5-mkmlizer: Saving duration: 0.328s
chaser-cz-share-qlora-out-v5-mkmlizer: Processed model ChaiML/reward_gpt2_medium_preference_24m_e2 in 6.957s
chaser-cz-share-qlora-out-v5-mkmlizer: creating bucket guanaco-reward-models
chaser-cz-share-qlora-out-v5-mkmlizer: Bucket 's3://guanaco-reward-models/' created
chaser-cz-share-qlora-out-v5-mkmlizer: uploading /tmp/reward_cache to s3://guanaco-reward-models/chaser-cz-share-qlora-out-v5_reward
chaser-cz-share-qlora-out-v5-mkmlizer: cp /tmp/reward_cache/config.json s3://guanaco-reward-models/chaser-cz-share-qlora-out-v5_reward/config.json
chaser-cz-share-qlora-out-v5-mkmlizer: cp /tmp/reward_cache/special_tokens_map.json s3://guanaco-reward-models/chaser-cz-share-qlora-out-v5_reward/special_tokens_map.json
chaser-cz-share-qlora-out-v5-mkmlizer: cp /tmp/reward_cache/tokenizer_config.json s3://guanaco-reward-models/chaser-cz-share-qlora-out-v5_reward/tokenizer_config.json
chaser-cz-share-qlora-out-v5-mkmlizer: cp /tmp/reward_cache/merges.txt s3://guanaco-reward-models/chaser-cz-share-qlora-out-v5_reward/merges.txt
chaser-cz-share-qlora-out-v5-mkmlizer: cp /tmp/reward_cache/vocab.json s3://guanaco-reward-models/chaser-cz-share-qlora-out-v5_reward/vocab.json
chaser-cz-share-qlora-out-v5-mkmlizer: cp /tmp/reward_cache/tokenizer.json s3://guanaco-reward-models/chaser-cz-share-qlora-out-v5_reward/tokenizer.json
chaser-cz-share-qlora-out-v5-mkmlizer: cp /tmp/reward_cache/reward.tensors s3://guanaco-reward-models/chaser-cz-share-qlora-out-v5_reward/reward.tensors
Stopping job with name chaser-cz-share-qlora-out-v5-mkmlizer
%s, retrying in %s seconds...
Stopping job with name chaser-cz-share-qlora-out-v5-mkmlizer
%s, retrying in %s seconds...
Stopping job with name chaser-cz-share-qlora-out-v5-mkmlizer
%s, retrying in %s seconds...
Starting job with name chaser-cz-share-qlora-out-v5-mkmlizer
Waiting for job on chaser-cz-share-qlora-out-v5-mkmlizer to finish
chaser-cz-share-qlora-out-v5-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaser-cz-share-qlora-out-v5-mkmlizer: ║     _____            __           __                                ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║       /___/                                                         ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║                                                                     ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║  Version: 0.9.5.post3                                               ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║  https://mk1.ai                                                     ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║                                                                     ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║  The license key for the current software has been verified as      ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║  belonging to:                                                      ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║                                                                     ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║  Chai Research Corp.                                                ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
chaser-cz-share-qlora-out-v5-mkmlizer: ║                                                                     ║
chaser-cz-share-qlora-out-v5-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaser-cz-share-qlora-out-v5-mkmlizer: Downloaded to shared memory in 19.098s
chaser-cz-share-qlora-out-v5-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmp1ty2nfr3, device:0
chaser-cz-share-qlora-out-v5-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaser-cz-share-qlora-out-v5-mkmlizer: quantized model in 13.792s
chaser-cz-share-qlora-out-v5-mkmlizer: Processed model Chaser-cz/share-qlora-out in 32.890s
chaser-cz-share-qlora-out-v5-mkmlizer: creating bucket guanaco-mkml-models
chaser-cz-share-qlora-out-v5-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaser-cz-share-qlora-out-v5-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaser-cz-share-qlora-out-v5
chaser-cz-share-qlora-out-v5-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaser-cz-share-qlora-out-v5/config.json
chaser-cz-share-qlora-out-v5-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaser-cz-share-qlora-out-v5/special_tokens_map.json
chaser-cz-share-qlora-out-v5-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaser-cz-share-qlora-out-v5/tokenizer_config.json
chaser-cz-share-qlora-out-v5-mkmlizer: cp /dev/shm/model_cache/tokenizer.model s3://guanaco-mkml-models/chaser-cz-share-qlora-out-v5/tokenizer.model
chaser-cz-share-qlora-out-v5-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaser-cz-share-qlora-out-v5/tokenizer.json
chaser-cz-share-qlora-out-v5-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaser-cz-share-qlora-out-v5/flywheel_model.0.safetensors
chaser-cz-share-qlora-out-v5-mkmlizer: loading reward model from ChaiML/reward_gpt2_medium_preference_24m_e2
chaser-cz-share-qlora-out-v5-mkmlizer: 
Loading 0:   0%|          | 0/291 [00:00<?, ?it/s]
Loading 0:  34%|███▎      | 98/291 [00:01<00:02, 91.44it/s]
Loading 0:  70%|███████   | 204/291 [00:02<00:00, 100.21it/s]
Loading 0: 100%|██████████| 291/291 [00:03<00:00, 82.16it/s] 
                                                            
/opt/conda/lib/python3.10/site-packages/transformers/models/auto/configuration_auto.py:950: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
chaser-cz-share-qlora-out-v5-mkmlizer:   warnings.warn(
chaser-cz-share-qlora-out-v5-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py:778: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
chaser-cz-share-qlora-out-v5-mkmlizer:   warnings.warn(
chaser-cz-share-qlora-out-v5-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py:469: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
chaser-cz-share-qlora-out-v5-mkmlizer:   warnings.warn(
chaser-cz-share-qlora-out-v5-mkmlizer: creating bucket guanaco-reward-models
chaser-cz-share-qlora-out-v5-mkmlizer: Bucket 's3://guanaco-reward-models/' created
chaser-cz-share-qlora-out-v5-mkmlizer: uploading /tmp/reward_cache to s3://guanaco-reward-models/chaser-cz-share-qlora-out-v5_reward
chaser-cz-share-qlora-out-v5-mkmlizer: cp /tmp/reward_cache/config.json s3://guanaco-reward-models/chaser-cz-share-qlora-out-v5_reward/config.json
chaser-cz-share-qlora-out-v5-mkmlizer: cp /tmp/reward_cache/tokenizer_config.json s3://guanaco-reward-models/chaser-cz-share-qlora-out-v5_reward/tokenizer_config.json
chaser-cz-share-qlora-out-v5-mkmlizer: cp /tmp/reward_cache/special_tokens_map.json s3://guanaco-reward-models/chaser-cz-share-qlora-out-v5_reward/special_tokens_map.json
chaser-cz-share-qlora-out-v5-mkmlizer: cp /tmp/reward_cache/merges.txt s3://guanaco-reward-models/chaser-cz-share-qlora-out-v5_reward/merges.txt
chaser-cz-share-qlora-out-v5-mkmlizer: cp /tmp/reward_cache/vocab.json s3://guanaco-reward-models/chaser-cz-share-qlora-out-v5_reward/vocab.json
chaser-cz-share-qlora-out-v5-mkmlizer: cp /tmp/reward_cache/tokenizer.json s3://guanaco-reward-models/chaser-cz-share-qlora-out-v5_reward/tokenizer.json
chaser-cz-share-qlora-out-v5-mkmlizer: cp /tmp/reward_cache/reward.tensors s3://guanaco-reward-models/chaser-cz-share-qlora-out-v5_reward/reward.tensors
Job chaser-cz-share-qlora-out-v5-mkmlizer completed after 67.9s with status: succeeded
Stopping job with name chaser-cz-share-qlora-out-v5-mkmlizer
Pipeline stage MKMLizer completed in 157.66s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.11s
Running pipeline stage ISVCDeployer
Creating inference service chaser-cz-share-qlora-out-v5
Ignoring service chaser-cz-share-qlora-out-v5 already deployed
Waiting for inference service chaser-cz-share-qlora-out-v5 to be ready
Inference service chaser-cz-share-qlora-out-v5 ready after 10.19518518447876s
Pipeline stage ISVCDeployer completed in 12.02s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.6012492179870605s
Received healthy response to inference request in 1.169032335281372s
Received healthy response to inference request in 1.3572051525115967s
Received healthy response to inference request in 1.2878808975219727s
Received healthy response to inference request in 1.1556708812713623s
5 requests
0 failed requests
5th percentile: 1.1583431720733643
10th percentile: 1.1610154628753662
20th percentile: 1.16636004447937
30th percentile: 1.1928020477294923
40th percentile: 1.2403414726257325
50th percentile: 1.2878808975219727
60th percentile: 1.3156105995178222
70th percentile: 1.3433403015136718
80th percentile: 1.4060139656066895
90th percentile: 1.503631591796875
95th percentile: 1.5524404048919678
99th percentile: 1.591487455368042
mean time: 1.3142076969146728
Pipeline stage StressChecker completed in 7.43s
chaser-cz-share-qlora-out_v5 status is now deployed due to DeploymentManager action
chaser-cz-share-qlora-out_v5 status is now inactive due to auto deactivation removed underperforming models
admin requested tearing down of chaser-cz-share-qlora-out_v5
Running pipeline stage ISVCDeleter
Checking if service chaser-cz-share-qlora-out-v5 is running
Tearing down inference service chaser-cz-share-qlora-out-v5
Service chaser-cz-share-qlora-out-v5 has been torndown
Pipeline stage ISVCDeleter completed in 5.27s
Running pipeline stage MKMLModelDeleter
Cleaning model data from S3
Cleaning model data from model cache
Deleting key chaser-cz-share-qlora-out-v5/config.json from bucket guanaco-mkml-models
Deleting key chaser-cz-share-qlora-out-v5/flywheel_model.0.safetensors from bucket guanaco-mkml-models
Deleting key chaser-cz-share-qlora-out-v5/special_tokens_map.json from bucket guanaco-mkml-models
Deleting key chaser-cz-share-qlora-out-v5/tokenizer.json from bucket guanaco-mkml-models
Deleting key chaser-cz-share-qlora-out-v5/tokenizer.model from bucket guanaco-mkml-models
Deleting key chaser-cz-share-qlora-out-v5/tokenizer_config.json from bucket guanaco-mkml-models
Cleaning model data from model cache
Deleting key chaser-cz-share-qlora-out-v5_reward/config.json from bucket guanaco-reward-models
Deleting key chaser-cz-share-qlora-out-v5_reward/merges.txt from bucket guanaco-reward-models
Deleting key chaser-cz-share-qlora-out-v5_reward/reward.tensors from bucket guanaco-reward-models
Deleting key chaser-cz-share-qlora-out-v5_reward/special_tokens_map.json from bucket guanaco-reward-models
Deleting key chaser-cz-share-qlora-out-v5_reward/tokenizer.json from bucket guanaco-reward-models
Deleting key chaser-cz-share-qlora-out-v5_reward/tokenizer_config.json from bucket guanaco-reward-models
Deleting key chaser-cz-share-qlora-out-v5_reward/vocab.json from bucket guanaco-reward-models
Pipeline stage MKMLModelDeleter completed in 5.80s
chaser-cz-share-qlora-out_v5 status is now torndown due to DeploymentManager action