Links are doing bad more then good

[mediadrug]

In one of my blog I started building content doing some keyword research etc. After a few weeks later and couple of posts. I see that my blog is getting rank in the search results. And rank is getting better everyday. So, to fasten I the process I started building links and what I am seeing after that is my rankings are falling. Previously, I did only some outreach via social media without any links and I got ranked. But now my with links I am losing visits. Should i continue to build links? or its just a minor thing that will be over soon? For the record I am only doing social bookmarking and forum signature link building.