Skip to contents

This function flags and removes outliers.

Usage

remove_outliers(df, vars, rm = TRUE)

Arguments

df

data.frame

vars

(character) variable names used in determining outliers

rm

(logical) remove outliers from df (default TRUE)

Value

df with outliers possibly removed

Details

Currently the method implemented uses the Mahalanobis distance to detect outliers, such that only numeric variables are supported. The critical chi-square value lies at the 99.9% mark and is based on the number of variables used in calculating the distances.

This is the method implemented in psych::outlier().

See also

Examples

df <- df |> remove_outliers(vars=c("x1","x2","x3"))

#> [1] "Removed:"
#> numeric(0)
#> [1] "Critical value:"
#> [1] 16.26624
#> [1] "Outliers:"
#>         243         305          37         378         359         219 
#> 14.40820192 14.37310846 13.97128100 13.15219892 11.69378632  9.69657496 
#>          17         109         268          46         119         395 
#>  9.67180106  9.65465157  9.50534227  9.36784557  9.30574221  9.23421491 
#>         313         456         430         214         157         263 
#>  9.03890931  8.89746509  8.67299228  8.47039647  8.27210903  8.22247356 
#>         380         314         232         143         330         279 
#>  8.21867514  8.18778700  8.13646213  8.01871729  7.84901338  7.82668794 
#>          91         343         337         149         240         283 
#>  7.80570370  7.75941144  7.70730894  7.62053960  7.58685369  7.44779042 
#>         315         164         148          88          60         286 
#>  7.31492022  7.13315939  7.04688069  7.04670870  7.00185287  6.95498981 
#>          85         499         479         110         271         428 
#>  6.89565530  6.86106754  6.84945561  6.73481600  6.66518239  6.60364716 
#>         457          80          41         390         300          74 
#>  6.58159745  6.56440622  6.50999723  6.50725825  6.49123289  6.48951112 
#>          92         391         404          68         322         132 
#>  6.47491955  6.38382686  6.37904646  6.34329666  6.30199948  6.29628409 
#>         351         489         498         127         471          66 
#>  6.28283144  6.26060749  6.26035339  6.20330976  6.08734158  6.07575107 
#>          87          63         299         447         189         275 
#>  5.98863958  5.97392604  5.97181415  5.94811540  5.89131287  5.84605044 
#>         436         262         104          62         169         388 
#>  5.84202440  5.79881683  5.75019803  5.74594388  5.69978226  5.68373837 
#>         100         445          22         371         188         289 
#>  5.62869546  5.58411923  5.56153660  5.56153391  5.53586896  5.50371617 
#>         462         346           2          77         374          27 
#>  5.47748884  5.45629373  5.43896289  5.41928574  5.40012274  5.36078202 
#>          61         150         102         130         256         450 
#>  5.35297922  5.35015251  5.32027131  5.22517896  5.22471457  5.07158278 
#>         486         222         293         230          64         265 
#>  5.01802023  5.00418983  4.95346693  4.94249909  4.93717237  4.82474063 
#>          56         103         233         253         112         290 
#>  4.77757642  4.76492825  4.75886838  4.75842382  4.71273168  4.67126423 
#>         274         500         364         126          44         356 
#>  4.62035101  4.61801162  4.55679933  4.55314014  4.54741211  4.53963130 
#>         405         135         191         118          20         448 
#>  4.53836478  4.52149923  4.48226241  4.44420032  4.38786216  4.37550545 
#>         412         335         220           5          82         215 
#>  4.36388082  4.36229145  4.35372727  4.32869391  4.30552268  4.30125747 
#>         174         406         324         231         444         159 
#>  4.27408482  4.23044004  4.22309812  4.14797705  4.14390925  4.14305544 
#>         124          71         177         341         393         354 
#>  4.12658027  4.12243450  4.10560686  4.06947458  4.05086375  4.01603714 
#>         192         340         385         382         190          65 
#>  3.98050209  3.92238574  3.90701563  3.88866441  3.84044446  3.80997291 
#>         353         478         228         381          57         328 
#>  3.80526488  3.77300535  3.76379889  3.75132012  3.73120070  3.71498962 
#>         298         422         246         203         465          29 
#>  3.71000373  3.70088339  3.66901470  3.63952481  3.60439225  3.60344275 
#>          97         255         125         168         352         383 
#>  3.60339090  3.59374557  3.58701244  3.58371746  3.56698534  3.55999416 
#>         291         414         429         106         138         239 
#>  3.55801320  3.54839599  3.54592489  3.49511286  3.49424277  3.48163131 
#>         470         237         425         308         154         483 
#>  3.45886469  3.44904845  3.44878745  3.43635869  3.43558048  3.43145279 
#>          67         187         199         133         107         492 
#>  3.42843224  3.42762851  3.41950851  3.39959045  3.39908529  3.38802294 
#>         421          21         491          53         131         473 
#>  3.38727773  3.36212943  3.33541119  3.29826036  3.24992481  3.23870781 
#>         120         194         161          58         147          15 
#>  3.20170809  3.18108192  3.17682689  3.16681673  3.12408429  3.11646090 
#>         185         463         116          16         170         369 
#>  3.10788395  3.10630440  3.06454909  3.03595910  3.02822120  3.02066178 
#>         433         484         368         485         193         278 
#>  3.01632881  2.99989688  2.98999479  2.93849969  2.91707590  2.90825407 
#>          89         370          34          96         251         136 
#>  2.90815895  2.89900660  2.89266842  2.88149865  2.87111059  2.84399246 
#>         334         166         236         342         307         272 
#>  2.82195421  2.82011184  2.81164169  2.80547416  2.79767147  2.78845160 
#>         360         259         297         292         209         303 
#>  2.74623786  2.73874958  2.72127583  2.72106493  2.71530350  2.70596268 
#>          83         264         316         258           9         121 
#>  2.69296377  2.67663424  2.65127064  2.62796973  2.61996280  2.61189852 
#>          28         281         329         487         227          86 
#>  2.59297788  2.57411520  2.57303301  2.56928528  2.56486045  2.55976178 
#>          24         407         152         304          23         482 
#>  2.55285024  2.52656857  2.51681128  2.51065932  2.49219153  2.44850150 
#>          31           7         218         115         287         339 
#>  2.44788819  2.43798161  2.41275865  2.40017257  2.38758875  2.37610054 
#>         221         344         336         413         269         439 
#>  2.37110149  2.36725610  2.34455965  2.33911564  2.31768847  2.31406075 
#>         301          30         348         495         338         312 
#>  2.30555772  2.30495299  2.29179891  2.28023465  2.27959969  2.25643026 
#>          14         423          59         345         332         205 
#>  2.25244559  2.23593403  2.23252980  2.22955488  2.21452030  2.20711125 
#>         294         179         151          13         180         288 
#>  2.20639055  2.19725252  2.17803204  2.15105593  2.14400396  2.13909319 
#>         306          84         481          55         427         285 
#>  2.13532584  2.12625563  2.12318914  2.11839422  2.11397233  2.10206566 
#>         410          33         392          98         452         162 
#>  2.09457370  2.09369425  2.07668971  2.07401904  2.06860249  2.06516077 
#>         225          90         273         432         477         384 
#>  2.05612462  2.04919820  2.04017023  2.03942017  2.03654921  2.02725434 
#>         434         476         375          49         494         257 
#>  2.01985633  2.01695963  2.01193162  2.00151998  1.98006308  1.97650688 
#>         111         387         252         129         451         490 
#>  1.97437986  1.94109541  1.92825849  1.90601193  1.90045259  1.87350530 
#>          40         134         175          48          54         250 
#>  1.87157225  1.85872261  1.85748311  1.85648029  1.84724996  1.84190853 
#>         377         183         248         394          25          42 
#>  1.83400431  1.82486974  1.82300033  1.81356781  1.80662210  1.80649985 
#>         460          35         267         437          10           1 
#>  1.80222504  1.79630639  1.79203770  1.79150411  1.76775136  1.76471120 
#>          11         493         435         461         173          93 
#>  1.74817130  1.73671303  1.72459122  1.72454231  1.72135095  1.71683543 
#>         196         468          94         365         167         358 
#>  1.71439011  1.67828318  1.67503958  1.65056183  1.64380812  1.63472234 
#>         245         347         211         146         349         181 
#>  1.60759402  1.58719060  1.58471244  1.58325426  1.58224774  1.56893744 
#>         389         160         204         327         200          99 
#>  1.56808798  1.56661767  1.56187209  1.54291550  1.54199595  1.53915756 
#>         216         198         114         247         137         282 
#>  1.53543446  1.52777504  1.51587589  1.50984248  1.48038562  1.45872828 
#>         454          32         399         475          47         140 
#>  1.42940070  1.42186697  1.40656551  1.40449896  1.39837610  1.38875735 
#>         372         249         238         206         128         355 
#>  1.37265596  1.37046569  1.36981049  1.36283010  1.35611019  1.34131611 
#>         431         141         401         123         276         163 
#>  1.33515532  1.32870581  1.32654620  1.32126555  1.31117494  1.30697479 
#>         139         400          36         182         496         172 
#>  1.29991412  1.29244975  1.28914438  1.26426827  1.26378136  1.24873688 
#>         117         418          72         408         488          18 
#>  1.24802294  1.24619181  1.24094655  1.22842963  1.22478107  1.21838791 
#>         155          95          70         398         350         474 
#>  1.21676412  1.21544994  1.21264929  1.19949274  1.19766549  1.18560004 
#>         366         270         202         331         234         459 
#>  1.17487205  1.17450629  1.17418385  1.17137814  1.15376008  1.14238627 
#>         266         449         403         438         480          69 
#>  1.13392950  1.13225662  1.11663427  1.11252199  1.09942216  1.08385234 
#>         317          19           6         122         142         464 
#>  1.07252734  1.06517822  1.06389867  1.06270673  1.05989449  1.05905670 
#>         469         446         416         419          52         260 
#>  1.05841726  1.05827084  1.05230409  1.04674815  1.04512448  1.04494812 
#>          73         424         453         165         105         113 
#>  1.04237308  1.04117542  1.04109955  1.03192943  1.01978821  0.98334579 
#>         235           8         284         153         254         458 
#>  0.98259643  0.98165982  0.98031086  0.97764457  0.96578971  0.94742139 
#>         223         363         455          39         409         145 
#>  0.93659725  0.93619474  0.90258675  0.89444828  0.88258939  0.87760915 
#>         241         296         426         171          50         417 
#>  0.87424691  0.87200095  0.85713814  0.83753253  0.81443852  0.81343681 
#>         357         302         244         361         156         319 
#>  0.80811092  0.80208333  0.79957350  0.77275722  0.75844912  0.75080874 
#>         402          76         379         295         213         420 
#>  0.73342617  0.72745887  0.72044804  0.72022406  0.71411942  0.71130714 
#>         326         325         415           4         195         362 
#>  0.70155437  0.68754847  0.67680364  0.67646708  0.66367497  0.65393162 
#>         201         210         396         309         367         277 
#>  0.62580676  0.61544225  0.61469229  0.61364449  0.61266010  0.59138737 
#>          78         466         443         497         373          75 
#>  0.58820038  0.58814182  0.57662491  0.57352392  0.56486332  0.55839762 
#>         184         158         333          26         472          38 
#>  0.54146821  0.52478036  0.51193807  0.49584457  0.48637403  0.48281523 
#>           3         207         323          43         280         226 
#>  0.46849393  0.46549095  0.44994509  0.43806684  0.43087201  0.42344804 
#>          79         144         197         242         212         467 
#>  0.42328584  0.41708898  0.40756447  0.38787941  0.38736335  0.34310467 
#>         176         217         397         261         229         376 
#>  0.33567717  0.33444978  0.33354115  0.33198617  0.32705036  0.32539796 
#>          51         108         320         186         208          81 
#>  0.32282080  0.31643519  0.31171751  0.29980778  0.29029652  0.28385665 
#>         386          12         411         441         101         310 
#>  0.27639575  0.27488894  0.23632620  0.22126071  0.21124668  0.18726526 
#>         178         318          45         440         321         442 
#>  0.15761132  0.15739631  0.12448906  0.11212378  0.09826185  0.09759480 
#>         311         224 
#>  0.06065240  0.05470448