Brake Problems 99 es300

My brakes are intermittently acting strange. Out of nowhere the pedal loses its consistent feel almost like the power is gone and I have to push fairly hard to stop. Seconds later it is normal.

Any ideas, fluid level is fine.

Flush the brake fluid out, and check the vacuum hose to the booster for leaks.