Maybe I could do like Level StaticMeshes that are loaded as entities, but this would only work if the actors in the map are Light Actors itself, and not components inside other Blueprints

The lights on the map don't use the Light class so how would you turn them off