submission_id: zonemercy-gemini-edit-v1_1351_v1
developer_uid: zonemercy
alignment_samples: 10162
alignment_score: 1.8231001654670982
best_of: 8
celo_rating: 1231.69
display_name: 0821v1-3
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
language_model: zonemercy/Gemini-Edit-v1-1e5ep1
max_input_tokens: 1024
max_output_tokens: 64
model_architecture: MistralForCausalLM
model_group: zonemercy/Gemini-Edit-v1
model_name: 0821v1-3
model_num_parameters: 12772070400.0
model_repo: zonemercy/Gemini-Edit-v1-1e5ep1
model_size: 13B
num_battles: 10162
num_wins: 4933
propriety_score: 0.718384697130712
propriety_total_count: 941.0
ranking_group: single
status: torndown
submission_type: basic
timestamp: 2024-08-21T20:46:09+00:00
us_pacific_date: 2024-08-21
win_ratio: 0.4854359378075182
Download Preference Data
Resubmit model
Running pipeline stage MKMLizer
Starting job with name zonemercy-gemini-edit-v1-1351-v1-mkmlizer
Waiting for job on zonemercy-gemini-edit-v1-1351-v1-mkmlizer to finish
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║ _____ __ __ ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║ / _/ /_ ___ __/ / ___ ___ / / ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║ / _/ / // / |/|/ / _ \/ -_) -_) / ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║ /_//_/\_, /|__,__/_//_/\__/\__/_/ ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║ /___/ ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║ ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║ Version: 0.10.1 ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║ Copyright 2023 MK ONE TECHNOLOGIES Inc. ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║ https://mk1.ai ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║ ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║ The license key for the current software has been verified as ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║ belonging to: ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║ ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║ Chai Research Corp. ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║ Expiration: 2024-10-15 23:59:59 ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║ ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: Downloaded to shared memory in 110.011s
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpp3bardwi, device:0
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: quantized model in 41.012s
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: Processed model zonemercy/Gemini-Edit-v1-1e5ep1 in 151.023s
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: creating bucket guanaco-mkml-models
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/zonemercy-gemini-edit-v1-1351-v1
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/zonemercy-gemini-edit-v1-1351-v1/config.json
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/zonemercy-gemini-edit-v1-1351-v1/special_tokens_map.json
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/zonemercy-gemini-edit-v1-1351-v1/tokenizer_config.json
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/zonemercy-gemini-edit-v1-1351-v1/tokenizer.json
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/zonemercy-gemini-edit-v1-1351-v1/flywheel_model.0.safetensors
Job zonemercy-gemini-edit-v1-1351-v1-mkmlizer completed after 254.44s with status: succeeded
Stopping job with name zonemercy-gemini-edit-v1-1351-v1-mkmlizer
Pipeline stage MKMLizer completed in 255.51s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.14s
Running pipeline stage ISVCDeployer
Creating inference service zonemercy-gemini-edit-v1-1351-v1
Waiting for inference service zonemercy-gemini-edit-v1-1351-v1 to be ready
Inference service zonemercy-gemini-edit-v1-1351-v1 ready after 334.0609645843506s
Pipeline stage ISVCDeployer completed in 335.04s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.036336898803711s
Received healthy response to inference request in 1.2619996070861816s
Received healthy response to inference request in 1.539224624633789s
Received healthy response to inference request in 1.4419684410095215s
Received healthy response to inference request in 1.6770436763763428s
5 requests
0 failed requests
5th percentile: 1.2979933738708496
10th percentile: 1.3339871406555175
20th percentile: 1.4059746742248536
30th percentile: 1.461419677734375
40th percentile: 1.500322151184082
50th percentile: 1.539224624633789
60th percentile: 1.5943522453308105
70th percentile: 1.649479866027832
80th percentile: 1.7489023208618164
90th percentile: 1.8926196098327637
95th percentile: 1.9644782543182373
99th percentile: 2.021965169906616
mean time: 1.5913146495819093
Pipeline stage StressChecker completed in 8.72s
zonemercy-gemini-edit-v1_1351_v1 status is now deployed due to DeploymentManager action
zonemercy-gemini-edit-v1_1351_v1 status is now inactive due to auto deactivation removed underperforming models
zonemercy-gemini-edit-v1_1351_v1 status is now torndown due to DeploymentManager action

Usage Metrics

Latency Metrics