Modifying an 06 Corolla LE

I'm close to buying an 06 Coroolla LE. I'm not much of a car guy, so I
need some advise. Can the car be modified so the ride (suspension,
tires, steering, etc.) is more performance oriented? I don't want to
go to the "S" model because they really change the outward appearance
to look more "street." I don't want to attract any extra attention to
the car. I'm just after some added driving fun. If you can help,
please list what you think I should/can modify. Thanks a lot. Also, is there
a downside to these changes? I drive to and from work in the city, but
go from MA to Maine each weekend and do a lot of back-road (not
off-road) country driving.