These permissions can be found under the “Presentation Objects by Component” tab on the Permission Set screen. Expand “IFS Base Functionality” and uncheck GUI Settings - Behavior Configurations in properties dialog and GUI Settings - Contextmenu configurations in properties dialog.

Note that this appears to still leave the tabs visible but makes them read only. I am unsure if hiding completely is an option.