Multiple datasets are there but want to restrict access to it

We have made multiple datasets and want to restrict that to specific user . Like we have 6 dataset and for few user we want them to see only 2 dataset and few only one and 3 dataset to other . How can we achieve this ?

Is there a way to revoke dataset access from user ?