Mass of cone
= m
Mass of hemisphere
= M
Centre of mass of cone from AB = -3r/4
Centre of mass of hemisphere from AB = 3r/8
Total mass of shape
= m+M
Centre of mass of shape
= y-bar
Emy = y-bar x Em
-mr/4 + 3rM/8 = (m+M)y-bar
-6mr + 3rM = 8(m+M)y-bar
y-bar = (3rM - 6rm)/8(m+M) = 3(M-2m)r/8(m+M)
I know this is a weird way of doing it.
If you think about it, the question tells you that 2m<M
Therefore the mass of the hemisphere is more than twice as heavy as the cone, so the centre of mass lies in the hemisphere section. So you calculate the centre of mass with the base being the vertex of the cone.