Commas set off a quotation from words used to introduce or identify the source of the quotation. A comma following a quotation goes inside the closing quotation mark.
Do not use a comma after a question mark or an exclamation point.
Do not use a comma to introduce a quotation with that or when you do not quote a speaker’s exact words.