submission_id: zonemercy-viral-ss-v0-1e5ep2_v85
developer_uid: chai_backend_admin
best_of: 4
celo_rating: 1247.73
display_name: tempv1-1
family_friendly_score: 0.5618000000000001
family_friendly_standard_error: 0.007016847725296595
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '####', 'Bot:', 'User:', 'You:', '<|im_end|>', '<|eot_id|>'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 64}
gpu_counts: {'NVIDIA RTX A6000': 1}
is_internal_developer: True
language_model: zonemercy/Viral-ss-v0-1e5ep2
latencies: [{'batch_size': 1, 'throughput': 0.38897856590248, 'latency_mean': 2.5707417142391207, 'latency_p50': 2.581002712249756, 'latency_p90': 2.8420652866363523}, {'batch_size': 3, 'throughput': 0.8091659284221875, 'latency_mean': 3.6980464005470277, 'latency_p50': 3.7205073833465576, 'latency_p90': 4.091854977607727}, {'batch_size': 5, 'throughput': 1.0719148776654512, 'latency_mean': 4.636176866292954, 'latency_p50': 4.628098368644714, 'latency_p90': 5.2061814069747925}, {'batch_size': 6, 'throughput': 1.1632005974568407, 'latency_mean': 5.118555265665054, 'latency_p50': 5.111450910568237, 'latency_p90': 5.8487735986709595}, {'batch_size': 10, 'throughput': 1.3747017534982104, 'latency_mean': 7.2159432721138, 'latency_p50': 7.2348021268844604, 'latency_p90': 8.176086616516113}]
max_input_tokens: 1024
max_output_tokens: 64
model_architecture: MistralForCausalLM
model_group: zonemercy/Viral-ss-v0-1e
model_name: tempv1-1
model_num_parameters: 22247282688.0
model_repo: zonemercy/Viral-ss-v0-1e5ep2
model_size: 22B
num_battles: 11507
num_wins: 5702
ranking_group: single
status: inactive
submission_type: basic
throughput_3p7s: 0.81
timestamp: 2024-11-12T12:29:13+00:00
us_pacific_date: 2024-11-12
win_ratio: 0.4955244633701225
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer
Waiting for job on zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer to finish
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: ║     _____            __           __                                ║
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: ║       /___/                                                         ║
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: ║                                                                     ║
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: ║  Version: 0.11.33                                                   ║
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: ║  https://mk1.ai                                                     ║
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: ║                                                                     ║
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: ║  The license key for the current software has been verified as      ║
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: ║  belonging to:                                                      ║
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: ║                                                                     ║
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: ║  Chai Research Corp.                                                ║
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: ║  Expiration: 2025-01-15 23:59:59                                    ║
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: ║                                                                     ║
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: Downloaded to shared memory in 130.770s
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpxpaa6vn4, device:0
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: Saving flywheel model at /dev/shm/model_cache
Connection pool is full, discarding connection: %s. Connection pool size: %s
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: quantized model in 52.842s
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: Processed model zonemercy/Viral-ss-v0-1e5ep2 in 183.612s
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: creating bucket guanaco-mkml-models
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/zonemercy-viral-ss-v0-1e5ep2-v85
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/zonemercy-viral-ss-v0-1e5ep2-v85/special_tokens_map.json
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/zonemercy-viral-ss-v0-1e5ep2-v85/config.json
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/zonemercy-viral-ss-v0-1e5ep2-v85/tokenizer_config.json
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/zonemercy-viral-ss-v0-1e5ep2-v85/tokenizer.json
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/zonemercy-viral-ss-v0-1e5ep2-v85/flywheel_model.1.safetensors
zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/zonemercy-viral-ss-v0-1e5ep2-v85/flywheel_model.0.safetensors
Job zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer completed after 217.57s with status: succeeded
Stopping job with name zonemercy-viral-ss-v0-1e5ep2-v85-mkmlizer
Pipeline stage MKMLizer completed in 218.69s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.17s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service zonemercy-viral-ss-v0-1e5ep2-v85
Waiting for inference service zonemercy-viral-ss-v0-1e5ep2-v85 to be ready
Inference service zonemercy-viral-ss-v0-1e5ep2-v85 ready after 190.70516061782837s
Pipeline stage MKMLDeployer completed in 191.71s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.6253819465637207s
Received healthy response to inference request in 2.6816141605377197s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 2.122131824493408s
Received healthy response to inference request in 2.4264509677886963s
Received healthy response to inference request in 3.3191707134246826s
5 requests
0 failed requests
5th percentile: 2.182995653152466
10th percentile: 2.2438594818115236
20th percentile: 2.3655871391296386
30th percentile: 2.4662371635437013
40th percentile: 2.5458095550537108
50th percentile: 2.6253819465637207
60th percentile: 2.6478748321533203
70th percentile: 2.67036771774292
80th percentile: 2.8091254711151126
90th percentile: 3.0641480922698974
95th percentile: 3.1916594028472898
99th percentile: 3.293668451309204
mean time: 2.6349499225616455
Pipeline stage StressChecker completed in 14.72s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.55s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 3.02s
Shutdown handler de-registered
zonemercy-viral-ss-v0-1e5ep2_v85 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3615.14s
Shutdown handler de-registered
zonemercy-viral-ss-v0-1e5ep2_v85 status is now inactive due to auto deactivation removed underperforming models