The house you see today was built around an existing 16th century Tower House. Today it is operated as The Barony Castle Hotel. During the second World War it was requisitioned for military use and became a school for training Polish staff officer training. This link to Poland is what it is famous for today since in its grounds it hosts The Great Polish Map of Scotland.
