This is another story featuring Lovecraft's fictional New England town of Kingsport.
The highest cliff overlooking Kingsport is topped with an ancient house the origin of which and the inhabitants of which are nothing more than untried rumor. An outsider to Kingsport decides to climb the cliff to find out the truth.
Other reviewers have called the story a nostalgic fairy tale. I think that is about as accurate a description as you can get.