function_bohik_2024-11-13

submission_id: function_bohik_2024-11-13

developer_uid: chai_backend_admin

celo_rating: 1246.1

display_name: function_bohik_2024-11-13

family_friendly_score: 0.5848

family_friendly_standard_error: 0.006968629133480989

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

is_internal_developer: True

model_group:

model_name: function_bohik_2024-11-13

num_battles: 12784

num_wins: 6392

ranking_group: single

status: inactive

submission_type: function

timestamp: 2024-11-13T16:55:10+00:00

us_pacific_date: 2024-11-13

win_ratio: 0.5

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.604680299758911s
Received healthy response to inference request in 3.559523344039917s
Received healthy response to inference request in 3.659581422805786s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 3.2947421073913574s
Received healthy response to inference request in 3.9496607780456543s
5 requests
0 failed requests
5th percentile: 3.3476983547210692
10th percentile: 3.400654602050781
20th percentile: 3.506567096710205
30th percentile: 3.579534959793091
40th percentile: 3.6195581912994386
50th percentile: 3.659581422805786
60th percentile: 3.7756131649017335
70th percentile: 3.8916449069976804
80th percentile: 4.0806646823883055
90th percentile: 4.342672491073609
95th percentile: 4.47367639541626
99th percentile: 4.578479518890381
mean time: 3.8136375904083253
%s, retrying in %s seconds...
Received healthy response to inference request in 5.088238477706909s
Received healthy response to inference request in 3.8415205478668213s
Received healthy response to inference request in 2.924964427947998s
Received healthy response to inference request in 4.29633355140686s
Received healthy response to inference request in 2.901127576828003s
5 requests
0 failed requests
5th percentile: 2.905894947052002
10th percentile: 2.910662317276001
20th percentile: 2.920197057723999
30th percentile: 3.1082756519317627
40th percentile: 3.474898099899292
50th percentile: 3.8415205478668213
60th percentile: 4.023445749282837
70th percentile: 4.205370950698852
80th percentile: 4.45471453666687
90th percentile: 4.77147650718689
95th percentile: 4.929857492446899
99th percentile: 5.056562280654907
mean time: 3.8104369163513185
%s, retrying in %s seconds...
Received healthy response to inference request in 2.110485792160034s
Received healthy response to inference request in 4.380731582641602s
Received healthy response to inference request in 3.5941197872161865s
Received healthy response to inference request in 2.5714285373687744s
Received healthy response to inference request in 3.1205263137817383s
5 requests
0 failed requests
5th percentile: 2.2026743412017824
10th percentile: 2.29486289024353
20th percentile: 2.479239988327026
30th percentile: 2.681248092651367
40th percentile: 2.900887203216553
50th percentile: 3.1205263137817383
60th percentile: 3.3099637031555176
70th percentile: 3.499401092529297
80th percentile: 3.7514421463012697
90th percentile: 4.066086864471435
95th percentile: 4.223409223556518
99th percentile: 4.349267110824585
mean time: 3.155458402633667
Pipeline stage StressChecker completed in 57.84s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 5.28s
Shutdown handler de-registered
function_bohik_2024-11-13 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3379.77s
Shutdown handler de-registered
function_bohik_2024-11-13 status is now inactive due to auto deactivation removed underperforming models