I doubt it's the firewall on the router, possibly a firewall on your own computer though.
More likely however it's something in your own computers IP setup, or the browser setup.
Can you browse to the router's configuration pages -
http://192.168.0.1 ?
Have a look in your browser (Internet explorer) connections options and see it's al set to do everything auto, with no proxy specified.