What determines how many wearable PFD you need on your vessel at any given time?

From my knowledge you need a life vest for every person on the boat. Not everyone has to wear it but it must be on board for every passenger you have.