If I understand it correctly, you feel vibration even applying your brake mainly on long trips?
This is caused by warpage on your rotors and drums. If you feel a shimmy while braking on the steering wheel, then your front rotors are warped and will need to be re-surfaced or replaced. If you feel a pedal pulsation while braking your drum brakes will need to be re-surfaced or replaced.