The rule of this card is as you have said in the first paragraph. When you destroy a Museum with 5 cards underneath, that player loose the points of thge Museum (4 points) plus the 5 points that the Museum granted him.
No anyone district are destroyed. I cannot believe that such a think have occur.
Please report the id of the game (or it name, at least).
Achiles(X)