Parties mull legal action against speaker over secret ballot