zonemercy-vingt-deux-v1-_8973

submission_id: zonemercy-vingt-deux-v1-_8973_v1

developer_uid: chai_backend_admin

best_of: 8

celo_rating: 1237.78

display_name: temp-3

family_friendly_score: 0.0

formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '####', 'Bot:', 'User:', 'You:', '<|im_end|>', '<|eot_id|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

ineligible_reason: num_battles<5000

is_internal_developer: True

language_model: zonemercy/Vingt-Deux-v1-1e5ep1

max_input_tokens: 1024

max_output_tokens: 64

model_architecture: MistralForCausalLM

model_group: zonemercy/Vingt-Deux-v1-

model_name: temp-3

model_num_parameters: 22247282688.0

model_repo: zonemercy/Vingt-Deux-v1-1e5ep1

model_size: 22B

num_battles: 2893

num_wins: 1386

ranking_group: single

status: torndown

submission_type: basic

timestamp: 2024-09-24T15:39:11+00:00

us_pacific_date: 2024-09-24

win_ratio: 0.4790874524714829

Download Preference Data

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name zonemercy-vingt-deux-v1-8973-v1-mkmlizer
Waiting for job on zonemercy-vingt-deux-v1-8973-v1-mkmlizer to finish
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: ║     _____            __           __                                ║
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: ║       /___/                                                         ║
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: ║                                                                     ║
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: ║  Version: 0.10.1                                                    ║
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: ║  https://mk1.ai                                                     ║
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: ║                                                                     ║
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: ║  belonging to:                                                      ║
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: ║                                                                     ║
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: ║  Chai Research Corp.                                                ║
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: ║                                                                     ║
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: Downloaded to shared memory in 170.087s
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpf3r004r0, device:0
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: quantized model in 51.239s
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: Processed model zonemercy/Vingt-Deux-v1-1e5ep1 in 221.327s
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: creating bucket guanaco-mkml-models
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/zonemercy-vingt-deux-v1-8973-v1
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/zonemercy-vingt-deux-v1-8973-v1/config.json
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/zonemercy-vingt-deux-v1-8973-v1/special_tokens_map.json
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/zonemercy-vingt-deux-v1-8973-v1/tokenizer_config.json
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/zonemercy-vingt-deux-v1-8973-v1/tokenizer.json
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/zonemercy-vingt-deux-v1-8973-v1/flywheel_model.1.safetensors
zonemercy-vingt-deux-v1-8973-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/zonemercy-vingt-deux-v1-8973-v1/flywheel_model.0.safetensors
Job zonemercy-vingt-deux-v1-8973-v1-mkmlizer completed after 263.15s with status: succeeded
Stopping job with name zonemercy-vingt-deux-v1-8973-v1-mkmlizer
Pipeline stage MKMLizer completed in 265.48s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.08s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service zonemercy-vingt-deux-v1-8973-v1
Waiting for inference service zonemercy-vingt-deux-v1-8973-v1 to be ready
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Failed to get response for submission blend_pudib_2024-09-20: ('http://mistralai-mistral-small-5341-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'read tcp 127.0.0.1:44058->127.0.0.1:8080: read: connection reset by peer\n')
Inference service zonemercy-vingt-deux-v1-8973-v1 ready after 203.68013858795166s
Pipeline stage MKMLDeployer completed in 204.02s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.358042478561401s
Received healthy response to inference request in 2.4360475540161133s
Received healthy response to inference request in 2.830972671508789s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 4.919933795928955s
Received healthy response to inference request in 2.9491469860076904s
5 requests
0 failed requests
5th percentile: 2.5150325775146483
10th percentile: 2.5940176010131837
20th percentile: 2.751987648010254
30th percentile: 2.8546075344085695
40th percentile: 2.90187726020813
50th percentile: 2.9491469860076904
60th percentile: 3.5127051830291744
70th percentile: 4.0762633800506585
80th percentile: 4.4704207420349125
90th percentile: 4.695177268981934
95th percentile: 4.807555532455444
99th percentile: 4.897458143234253
mean time: 3.4988286972045897
%s, retrying in %s seconds...
Received healthy response to inference request in 2.4545915126800537s
Received healthy response to inference request in 2.6284587383270264s
Received healthy response to inference request in 2.8248112201690674s
Received healthy response to inference request in 5.229024171829224s
Received healthy response to inference request in 3.2158446311950684s
5 requests
0 failed requests
5th percentile: 2.4893649578094483
10th percentile: 2.524138402938843
20th percentile: 2.5936852931976317
30th percentile: 2.6677292346954347
40th percentile: 2.746270227432251
50th percentile: 2.8248112201690674
60th percentile: 2.9812245845794676
70th percentile: 3.1376379489898683
80th percentile: 3.6184805393219
90th percentile: 4.423752355575561
95th percentile: 4.826388263702392
99th percentile: 5.148496990203857
mean time: 3.270546054840088
Pipeline stage StressChecker completed in 36.87s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 5.50s
Shutdown handler de-registered
zonemercy-vingt-deux-v1-_8973_v1 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage MKMLProfilerDeleter completed in 0.13s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage MKMLProfilerTemplater completed in 0.11s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service zonemercy-vingt-deux-v1-8973-v1-profiler
Waiting for inference service zonemercy-vingt-deux-v1-8973-v1-profiler to be ready
Tearing down inference service zonemercy-vingt-deux-v1-8973-v1-profiler
%s, retrying in %s seconds...
Creating inference service zonemercy-vingt-deux-v1-8973-v1-profiler
Waiting for inference service zonemercy-vingt-deux-v1-8973-v1-profiler to be ready
Tearing down inference service zonemercy-vingt-deux-v1-8973-v1-profiler
%s, retrying in %s seconds...
Creating inference service zonemercy-vingt-deux-v1-8973-v1-profiler
Waiting for inference service zonemercy-vingt-deux-v1-8973-v1-profiler to be ready
Tearing down inference service zonemercy-vingt-deux-v1-8973-v1-profiler
clean up pipeline due to error=%s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage MKMLProfilerDeleter completed in 0.15s
Shutdown handler de-registered
zonemercy-vingt-deux-v1-_8973_v1 status is now inactive due to auto deactivation removed underperforming models
Shutdown handler de-registered
Shutdown handler de-registered
zonemercy-vingt-deux-v1-_8973_v1 status is now torndown due to DeploymentManager action