Is it correct to say on purpose?

Yes, "on purpose" is a correct phrase. It means "intentionally" or "deliberately."

Here are some examples:

* "I tripped her on purpose."

* "I did that on purpose to get your attention."

* "He didn't do it on purpose, it was an accident."