Backlinks are super important and crucial to your SEO success!
Stop building a mass amount of links on directories. Stick with directories that are of higher quality (Yelp, Yellow Pages, Google+, etc.) and add relevance to your brand.
Make sure you are always putting your links on relevant websites. You want the right people coming to your site, not just some random group.