Figure out whether you'll owe taxes or penalties, and consider how your decision will affect the growth of your retirement savings to decide if it's the right move for you.