I dove this site about 4 times now. Twice for my Advance certification and a couple other fun dives. I travel about 1 1/2 hours south to enjoy it and I know others that travel even farther. There is a car to explore at about 40 feet down, the quarry walls are so cool, especially if you've never dove in a quarry before. This quarry has some of the best viz as it gets very little top soil run off. Another car to check out at 80 feet down. I'm not a cave diver, however there is a network of caves from when they mined the marble. I believe there is a map available that some divers have made of the underwater cave system. You would want to ask Bottom Time Scuba in Rutland or Victory Sports in Colchester Vermont.
Go from Rutland Vermont to West Rutland on route 4 B. When in the center of West Rutland turn right onto Marble street extension and follow for about 3 miles on your right. There are about 4 large Marble blocks that are place at the entrance where you need to park on the right side of the road. You can't see the quarry from the road. You need to walk in your gear about 150 yards. There are two common entrances. One to the left is a giant stride entrance and the one to the right is a walk in spot.