Prevent Destination Warehouse address from overwriting single occurence

When a Destination Warehouse ID is populated on an inter-site PO Line, the remote warehouse address overwrites the Single Occurrence address entered on the order Delivery Address tab. Is there a way to prevent this from happening? So the PO Line uses the Single Occurrence address instead? We are using IFS 9.