A homeowner who built a 13-foot-by-13-foot brick pavilion without permits must now demolish it, the city of Atlanta’s Board of Appeals ruled, after considering a neighbor’s complaint that the structure blocked a view of the club’s golf course.