You should be able to plug it in and find it works - make sure you power off modem and PC(s) while you set up ethernet.
Router settings can all be configured once connected up by browsing (internet explorere, Firefox, etc) using
http://192.168.1.1 default password and login = admin which is worht changing. Configure wireless setups using the wired connection and then you'll be off and running.