There is absolutely a food safety reason to replace a sponge. Most bacteria don’t just die when they’re in dry nutrient poor environments. They desiccate themselves into a spore form. Those spores can stay like that for very long periods of time until their environment becomes more wet. Then they can continue their lifecycle until they dry out again. Dry doesn’t mean sterile.