Like many retail industries that sell discretionary products, the Hat and Cap Stores industry felt the negative effects of the recession.