This is for my Belkin Router not sure your model so might be slightly diffrent but hopefully not.
1. Open your Web Browser (Internet explorer, Firefox etc etc)
2. Type
http://192.168.2.1/
3. Look for Wireless option (on left hand side in my settings) and click on Channel and SSID and thats were you set it all up. (I assume you know what to do from here ?)
Note* You may be asked for a password. If you didnt set one up then just click submit but if you did then just enter it first. If not sure check your manual.
Hope you get it all working ok