Theoretically, if the pulley is plastic, it will be expanding faster than the captive bearing inside, this will increase the clearance between the ID of the pulley and the OD of the bearing. There may be some movement.
But i could be wrong too, whilst talking out of my arse.