function_felet_2024-12-18

developer_uid: jxlu90

submission_id: function_felet_2024-12-18

model_name: gasol_1kctx

model_group:

status: inactive

timestamp: 2024-12-18T03:59:59+00:00

num_battles: 12406

num_wins: 6384

celo_rating: 1273.85

family_friendly_score: 0.5888

family_friendly_standard_error: 0.006958657341757819

submission_type: function

display_name: gasol_1kctx

is_internal_developer: True

ranking_group: single

us_pacific_date: 2024-12-17

win_ratio: 0.5145897146541996

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 2048, 'best_of': 4, 'max_output_tokens': 64}

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.03012490272522s
Received healthy response to inference request in 2.2746167182922363s
Received healthy response to inference request in 3.3104326725006104s
Received healthy response to inference request in 2.5733230113983154s
Received healthy response to inference request in 4.8153722286224365s
5 requests
0 failed requests
5th percentile: 2.334357976913452
10th percentile: 2.394099235534668
20th percentile: 2.5135817527770996
30th percentile: 2.7207449436187745
40th percentile: 3.015588808059692
50th percentile: 3.3104326725006104
60th percentile: 3.598309564590454
70th percentile: 3.8861864566802975
80th percentile: 4.187174367904663
90th percentile: 4.50127329826355
95th percentile: 4.658322763442993
99th percentile: 4.783962335586548
mean time: 3.4007739067077636
%s, retrying in %s seconds...
Received healthy response to inference request in 2.015434503555298s
Received healthy response to inference request in 2.044442892074585s
Received healthy response to inference request in 1.9879398345947266s
Received healthy response to inference request in 3.353541851043701s
Received healthy response to inference request in 2.4108259677886963s
5 requests
0 failed requests
5th percentile: 1.9934387683868409
10th percentile: 1.9989377021789552
20th percentile: 2.0099355697631838
30th percentile: 2.0212361812591553
40th percentile: 2.03283953666687
50th percentile: 2.044442892074585
60th percentile: 2.1909961223602297
70th percentile: 2.337549352645874
80th percentile: 2.5993691444396974
90th percentile: 2.9764554977416995
95th percentile: 3.1649986743927
99th percentile: 3.315833215713501
mean time: 2.3624370098114014
Pipeline stage StressChecker completed in 31.20s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.17s
Shutdown handler de-registered
function_felet_2024-12-18 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3669.65s
Shutdown handler de-registered
function_felet_2024-12-18 status is now inactive due to auto deactivation removed underperforming models