Tory Lords are concerned about PEP rules too apparently.
The obvious answer is a “bank of last resort” where those too risky deposit their money with the Treasury, who of course work with the Bank of England to back any deposits.
They could even work with HMRC to share data and automate their tax arrangements
