Why is custom sidebars plugin so slow?

Is there any way for me to speed it up? I have been looking at why my websites load time is slow and custom sidebars is the reason why. It accounts for about 3 seconds of load on average on all my sites. Can this be lowered at all? Can I or you make it less clunky?