What is the main thing that you should be worried?

[anush]

The main thing you should worry about your site apart from on-page optimization factors is content.

Quality content remains important. Better ranking URLs feature more text as well as keywords on-page, are enriched with additional media (such as images and videos) and are well linked internally.

I agree quality content is a safe bet. As they always say 'Content is the King'.