No, It is not required to buy MassMailer licenses for all the Salesforce users. License is required only for those users who will be sending mass emails and use other features of the MassMailer.