Mortgage withdrawal after Contract Exchange

Can a mortgage be withdrawn after the contract exchange? There is a rare chance that a lender could withdraw after the exchange has taken place.