Starter bearings

Hi guys. I have a 92 Buick Century Wagon 3.3L. The starter squeals. Looks like the brass drive end bearing is not overly worn but is dry. The roller bearing at the commutator end looks fine. I tied to get a bearing kit, but the brass bearing is too thin compared to the original and will not fit. I search for over an hour and cannot find a similar brass drive end bearing for this starter. The interesting thing is that the roller bearing happens to be the exact size as the brass bearing. I used a caliper to measure. My question is, I've noticed most starter drive end bearings are the brass sleeve. Since the roller bearing is the exact size in all dimensions as the brass sleeve bearing, would the be an issue if I used it instead of the brass bearing?
Thanks.
Richard