Here is a script we threw together to uninstall the patch. If you installed the patch using Kaseya, you should be able to use Kaseya to un-install (roll-back), however if it was installed using Windows update, then our script should work. Please test on a few machines before wholesale deploying it.
virtualadministrator.com/.../uninstall-kb2823324
You can easily create a view that will show you which machines have the patch installed. In the View screen, go to Patch management section, and check box next to "Machines with installed patch..." and put "2823324" in the box.
