This whole question hinges on the seperation of the economic migrants, people who can live at home but want more money, etc, and so leave home to find it and refugees who are escaping war and risk where they live.
The right wing agenda is to blur this distinction and so just say no to anyone wanting to come to the UK. The right wing media also seeks to create a sense of hysteria with regards to this subject so as to validate any policies that may arise to reduce the migrant/refugee intake.
We are more than happy to demand Europe to allow our UK citizens to emigrate to France, Spain, etc. but would be indigant if the reverse happened. Imagine the Daily Mail headlines if the South of England had 400,000 non-English speaking Spanish residents
I hear a lot of complaining about how many "migrants" there are, how it is all the EU's fault, how the UK, the 4th richest country in the world, can't help these people, etc but what I don't hear is any constructive discussion on how to start solving the cause of the problem.
Regarding the refugee point, let me ask this question: if you and your family were at risk of being shot, bombed, beheaded, etc where you currently lived, what would you do?