Brexit talks weigh on pound as sides dig in