Govardhan puja is done to worship a mountain which Lord Krishna had picked with one finger to save the crops of Dwarka.
Read this post on rgyan.com/blogs