This behaviour depends on the browser and whether you install or update your plugin.
See the table below for reference : 

  
Browser
Install
Update
Internet ExplorerPage refresh neededBrowser restart needed
Safari 10 & lower


No refresh needed,
AdapterJS auto-reloads the plugin list

Browser restart needed
(Actually quitting Safari, not just closing all windows)

Safari 11 (with plugin)No refresh needed,
AdapterJS auto-reloads the plugin list

Browser restart needed
(Actually quitting Safari, not just closing all windows)