go off with

1. to commit adultery 2. to take something without asking

Examples

1. I don't think she can go off with her hubby's best friend, it's just rumors. 2. Children should be taught not to go off with anything.