Mike,
Yes, that is rust. I found it odd for a brand new part from Olthoff, but I certainly made sure the surfaces that make contact were clean.
Regarding the rocking back and forth of the bearing: We thought that very odd as well. Do you have a photo of the flat plate you added? I want to...