Can I Configure Salesforce Adoption Manager to Send Emails to a Specific Group of Users Only?

No. When you enable Adoption Manager, it’s turned on for all users in your org. But users can opt out of receiving future messages from the footer of any email from the program.

Check the below link for more info