In a geometric sequence you go to the next term by multiplying by the common ratio, and go to the previous term by dividing by the common ratio. So, if the sequence has first term
a1, then
a2=a1r, and
a3=a2r=a1r2.
Here, you're given the values of
a1,a2,a3 in terms of
k, and you're told to show that something is equal to zero. Now, since we know that
a2=a1r and
a3=a2r, we get the result that
r=a1a2=a2a3 (which is incidentally also why it's called the "common ratio", because
anan+1=r for any n, but that's outside of the scope of this question).
Since
r−r=0, we can replace the first r by
a2a3 and the second r by
a1a2 and set them equal to zero. Writing these in terms of
k gives
k2k−15−k+4k=0. Multiplying through by
k(k+4) gives
(2k−15)(k+4)−k2=0... try and guess what you have to do now