I've yet to come across anyone who was happy with those adjustable drill attachments.
hole saws are great for the smaller sizes, and for the bigger sizes the rotary tool/circle jig can't be beat.
the more of them you are doing the faster it gets.
get a garbage can (with flat clean rim) and lay the tile down face down
get a straight edge or tape measure and lay it from corner to corner, mark a line roughly where the center should be
do the same thing across the other two corners and voila, you have the exact middle with no measuring (this will save you at least an hour over that many speakers)
then cut the hole.
the whole operation should only take about 30 seconds.
the rotary tool is one of my tools that if it got lost or broken I would get another one tomorrow even if they cost twice as much.
ps: for normal ceiling tiles I've only broken a few bits over the last 5-6 years. drywall chews them up fast, but ceiling tiles are like paper
pps: I know your asbestos comment was tongue-in-cheek, but if you read the label that comes with a new package of tiles there are warnings that they do contain silica (some of them anyway), which is known to be harmful. so if you're doing a lot of them in a poorly ventilated space it might be good to wear a mask.
Jason