When closing a business, you must cancel your registration with both the federal government and the state. Most states have a change request form to fill out. Visit your state’s department of revenue website for more information.