Lonely black holes revealed by passing gravitational waves