It's a very strong and negative phrase, often used to express frustration, anger, or despair in a relationship.
Here's a breakdown:
* Al diablo: This means "To hell" or "Damn"
* Lo nuestro: This means "Our [relationship]"
So, the phrase basically means the speaker is rejecting or dismissing the relationship, often out of anger or frustration.