The nondescript red brick building on Grove Street has served many different purposes, from an ice house to a billiards hall.