No, "committing arson" is grammatically correct. "Committing" is the present participle of the verb "to commit," and it is used in this context to indicate the act of carrying out arson.
"Saying" is a verb that refers to the act of speaking, so it doesn't fit in this context.
