Do you have a turbo timer? If not, that would be a good investment.

It allows your turbo to cool down slowly rather than suddenly, which will cause the ball bearings to warp over time, and make them sound rather noisy like yours.

A thought anyways