In my humble opinion, I tend to not let let the fish stay in the fridge for more than a day before getting packaged up or eaten. Bigger deal though seems to be the water temp the fish were caught in and how well they were taken care of before hitting the skillet. Filleting warm dead fish leads to more problems than I have encountered with fish stored in the fridge for 2-3 days.
