Is it wrong to use a comma after an adverb in first position?

'Yesterday, Amy broke the hammer.' This is the sentence in question. Is there a grammar rule to support a comma after the adverb 'Yesterday' in first position?