Bailing out of agreement to purchase.

Can I cancel a residential purchase agreement if buyers do not remove the contingencies in a certain time frame?

I don't know what state you're in, but CA law is that you have 17 days to cancel for any reason.  Ideally you designated those dates in the purchase agreement so they wold be in breech if they do not comply to the terms agreed upon.