Add Links Toolbar To Taskbar -

Right-click the "Links" label and uncheck "Show Text" or "Show Title" to display only the icons.