function_nipib_2024-12-19

developer_uid: jxlu90

submission_id: function_nipib_2024-12-19

model_name: run_3_v65

model_group:

status: inactive

timestamp: 2024-12-19T00:11:35+00:00

num_battles: 7195

num_wins: 3698

celo_rating: 1276.86

family_friendly_score: 0.0

family_friendly_standard_error: 0.0

submission_type: function

display_name: run_3_v65

is_internal_developer: True

ranking_group: single

us_pacific_date: 2024-12-18

win_ratio: 0.5139680333564975

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 2048, 'best_of': 4, 'max_output_tokens': 64}

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.9031028747558594s
Received healthy response to inference request in 1.9981284141540527s
Received healthy response to inference request in 2.392857789993286s
Received healthy response to inference request in 5.214031934738159s
Received healthy response to inference request in 4.4779908657073975s
5 requests
0 failed requests
5th percentile: 1.922107982635498
10th percentile: 1.9411130905151368
20th percentile: 1.979123306274414
30th percentile: 2.0770742893218994
40th percentile: 2.2349660396575928
50th percentile: 2.392857789993286
60th percentile: 3.2269110202789304
70th percentile: 4.060964250564575
80th percentile: 4.62519907951355
90th percentile: 4.9196155071258545
95th percentile: 5.066823720932007
99th percentile: 5.184590291976929
mean time: 3.197222375869751
%s, retrying in %s seconds...
Received healthy response to inference request in 3.0806398391723633s
Received healthy response to inference request in 2.47976016998291s
Received healthy response to inference request in 3.036670446395874s
Received healthy response to inference request in 3.0335500240325928s
Received healthy response to inference request in 1.6719985008239746s
5 requests
0 failed requests
5th percentile: 1.8335508346557616
10th percentile: 1.9951031684875489
20th percentile: 2.318207836151123
30th percentile: 2.5905181407928466
40th percentile: 2.81203408241272
50th percentile: 3.0335500240325928
60th percentile: 3.034798192977905
70th percentile: 3.036046361923218
80th percentile: 3.0454643249511717
90th percentile: 3.0630520820617675
95th percentile: 3.0718459606170656
99th percentile: 3.0788810634613037
mean time: 2.660523796081543
Pipeline stage StressChecker completed in 31.61s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.28s
Shutdown handler de-registered
function_nipib_2024-12-19 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 15, running shutdown handler
function_nipib_2024-12-19 status is now inactive due to auto deactivation removed underperforming models