Labour might be open to working with the Opportunity Party, but a former leader apparently wouldn't be so keen.