If its that serious, like something abusive, I would not let my child go, and I would get the authorities involved and try to get the court order changed...if its something less,& wont effect the child as much as it may you....I would let the child go & try to enjoy time with his father.