zonemercy-gemini-edit-v1_1351

developer_uid: zonemercy

submission_id: zonemercy-gemini-edit-v1_1351_v1

model_name: 0821v1-3

model_group: zonemercy/Gemini-Edit-v1

status: torndown

timestamp: 2024-08-21T20:46:09+00:00

num_battles: 10162

num_wins: 4933

celo_rating: 1231.47

family_friendly_score: 0.0

submission_type: basic

model_repo: zonemercy/Gemini-Edit-v1-1e5ep1

model_architecture: MistralForCausalLM

model_num_parameters: 12772070400.0

best_of: 8

max_input_tokens: 1024

max_output_tokens: 64

display_name: 0821v1-3

is_internal_developer: True

language_model: zonemercy/Gemini-Edit-v1-1e5ep1

model_size: 13B

ranking_group: single

us_pacific_date: 2024-08-21

win_ratio: 0.4854359378075182

generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

Resubmit model

Running pipeline stage MKMLizer
Starting job with name zonemercy-gemini-edit-v1-1351-v1-mkmlizer
Waiting for job on zonemercy-gemini-edit-v1-1351-v1-mkmlizer to finish
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║     _____            __           __                                ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║       /___/                                                         ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║                                                                     ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║  Version: 0.10.1                                                    ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║  https://mk1.ai                                                     ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║                                                                     ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║  belonging to:                                                      ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║                                                                     ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║  Chai Research Corp.                                                ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ║                                                                     ║
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: Downloaded to shared memory in 110.011s
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpp3bardwi, device:0
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: quantized model in 41.012s
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: Processed model zonemercy/Gemini-Edit-v1-1e5ep1 in 151.023s
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: creating bucket guanaco-mkml-models
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/zonemercy-gemini-edit-v1-1351-v1
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/zonemercy-gemini-edit-v1-1351-v1/config.json
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/zonemercy-gemini-edit-v1-1351-v1/special_tokens_map.json
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/zonemercy-gemini-edit-v1-1351-v1/tokenizer_config.json
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/zonemercy-gemini-edit-v1-1351-v1/tokenizer.json
zonemercy-gemini-edit-v1-1351-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/zonemercy-gemini-edit-v1-1351-v1/flywheel_model.0.safetensors
Job zonemercy-gemini-edit-v1-1351-v1-mkmlizer completed after 254.44s with status: succeeded
Stopping job with name zonemercy-gemini-edit-v1-1351-v1-mkmlizer
Pipeline stage MKMLizer completed in 255.51s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.14s
Running pipeline stage ISVCDeployer
Creating inference service zonemercy-gemini-edit-v1-1351-v1
Waiting for inference service zonemercy-gemini-edit-v1-1351-v1 to be ready
Inference service zonemercy-gemini-edit-v1-1351-v1 ready after 334.0609645843506s
Pipeline stage ISVCDeployer completed in 335.04s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.036336898803711s
Received healthy response to inference request in 1.2619996070861816s
Received healthy response to inference request in 1.539224624633789s
Received healthy response to inference request in 1.4419684410095215s
Received healthy response to inference request in 1.6770436763763428s
5 requests
0 failed requests
5th percentile: 1.2979933738708496
10th percentile: 1.3339871406555175
20th percentile: 1.4059746742248536
30th percentile: 1.461419677734375
40th percentile: 1.500322151184082
50th percentile: 1.539224624633789
60th percentile: 1.5943522453308105
70th percentile: 1.649479866027832
80th percentile: 1.7489023208618164
90th percentile: 1.8926196098327637
95th percentile: 1.9644782543182373
99th percentile: 2.021965169906616
mean time: 1.5913146495819093
Pipeline stage StressChecker completed in 8.72s
zonemercy-gemini-edit-v1_1351_v1 status is now deployed due to DeploymentManager action
zonemercy-gemini-edit-v1_1351_v1 status is now inactive due to auto deactivation removed underperforming models
zonemercy-gemini-edit-v1_1351_v1 status is now torndown due to DeploymentManager action