Outliers represent a fundamental challenge in the empirical finance research. We investigate whether the routine techniques used in finance research to identify and treat outliers are appropriate for the data structures we observe in practice. Specifically, we propose a multivariate identification strategy that can effectively detect outliers. We also introduce an estimator that minimizes the bias outliers caused in both cross-sectional and panel regressions and provide outlier mitigation guidance. Using replications of four recently published studies in premier finance journals, we show how adjusting for multivariate outliers can lead to significantly different results.