Leave voters feel job losses are ‘worth it’ for sovereignty