Deciding whether to handle payroll and tax responsibilities in-house or outsource to a third-party provider is a crucial decision for small business owners. Running payroll can be time-consuming and complicated, and even a single payroll error can be costly.