Revoking amenity privlages

How can we enforce revoking an amentiy privlage? We have an unruly resident who doesn't obey the rules of the pool so we want to suspend their privlage for a period of time. The only problem is that if he comes up and the pool monitor or lifeguard asks him to leave and he doesn't what can we do? The police won't do anything because he isn't breaking a law.

We had residents sign the pool rules when they received their pool key. It states in the rules that a homeowner can have priveledges revoked and fines assessed for any violation of the pool rules by themselves and/or relatives, guests, etc. It also states that they can be charged for damage done by the member and/or guests.