Reading the paragraph.
We saw it from miles away, sitting atop the crest of a hill. The old walls were crumbling, but you could still see the outlines of the vast parapets and stone towers.

The author is most likely looking at 
an old house.
an old castle.
an old mansion.
an old building.