Black hole mergers put limits on star-destroying supernovae