A public-house sign at Lincoln, is a corruption of the Three Gowts, that is, drains or sluices, which at one time conducted the waters of a large lake into the river Witham. The name of the inn is now the Black Goats.
Source: Dictionary of Phrase and Fable, E. Cobham Brewer, 1894