17mb for a firewall

It uses InstallShield for MSI, i.e. Windows Installer so your system should be able to run MSI installs. Other Installshield Installers use InstallShields own proprietary CAB file format to install, not MSI, so NetGuard could be using that.
The 'C:\Windows\installer' directory is a cache for MSI installer files. You should be running Windows Installer 3.1 if you have SP2 and have done any Windows Updates, if not do an update and update to 3.1. Also make sure the Windows Installer Service is not disabled, it should be set to 'Manual' in the Services Console.
I ran the setup.exe and didn't get any problems, although I borked the install when it asked me to uninstall other firewalls before continuing as I use ZoneAlarm.
Try typing 'MSIEXEC' into the START > RUN box and hit enter, you should get a Windows Installer Dialogue box pop up, this should tell you if it's installed and if so, what version, mine says:
Windows ® Installer. V 3.01.4000.1823