Dictionary of Ichthyology
mackerel sky = a type of altocumulus clouds, indicating moisture and instability; hence the saying "Mackerel sky, mackerel sky, Never long wet and never long dry". Presumably named for the wavy pattern as seen on mackerel flanks.
