The elite people go to exclusive places and parties to stay away from regular people. There may be drugs or hookers there but doesn't mean all of them consume them, or that even know about their existence because maybe were even located on a separate part of the island.True. Most people go to Epstein's island for the open bar.
Maybe they see hot women there and think they are guest models, normal workers from there, people who lives with that rich person or something instead of assuming they are hookers paid by the owner of the place, and maybe didn't knew that some of them were minors.
I assume the closer people to him knew about this and were his "clients", but other ones maybe simply went there once or twice to have a regular party or vacations and didn't see or knew anything about this.