Sir Oliver has opposed the Government's plan to restrict jury trials.
Sir Oliver intervened on Second Reading of the Courts and Tribunals Bill.
Oliver said: "My hon. Friend is making some very important points. There is a more fundamental point about public perception, which he may come on to in a moment. If we pass this legislation at a time when confidence in this place and in conventional politics is at an exceedingly low ebb, we will be sending a signal to people that this place does not trust 12 good men and true to make decisions, and, in fact, that we want to take that decision away from them. Does he agree that that will further erode confidence in conventional mainstream politics?"