Conduction is energy transfer due to the vibrating of the particles which the colour has no effect upon.
The colour affects the rate of radiation absorption.
The speed of conduction is the same for all energies since it is the particles within the materials which transfer the energy.