I had this issue after migrating to a new server. I moved to a dedicated server with twice the horsepower and the public facing side of the site was running 20 second load times, and super high CGI CPU. Running on IIS, you need to update all the file/folder permissions. Ensure your IIS user has read, write and modify permission. The modify was the ticket as PS was not able to delete certain file.