For my dissertation, I looked at the effects of artificial sweeteners on glucose levels. This involved getting participants to drink tea/coffee and have their glucose measured. Each participant took part in two trials - a sugar trial, then a sweetener trial. I took 7 glucose readings per trial per participant over the course of an hour (fasting glucose reading, then 6 readings every 10 minutes following consumption of their drink). I would then compare the sugar glucose to sweetener glucose to see if sweeteners elicited a glucose response. I also collected demographic data from all my participants including age, gender, height, weight (for BMI calculation), exercise levels and whether or not they frequently consumed sweeteners. My reason for collecting all this data was to see if there was any correlation between these demographics and glucose response. I.e, did BMI/age/gender etc effect glucose response in any way.
Now my supervisor for my dissertation only just started working at my uni this January and she told me she knew nothing about stats (she's a microbiologist, apparently you don't need stats for that so she apparently never learnt anything about them) and referred me to the dissertation module leader for any help I needed with them since she's the go-to stats person and took us for our stats lectures in year 2.
So once I'd collected all my data, I saw the module leader as instructed for advice on how to analyse my results. Firstly, the module leader told me that I couldn't do any testing with my demographical data. She told me to just disregard it all. I tried asking if I could do anything at all with it since it seemed a shame not to try and incorporate it, but she said no because it wouldn't show anything of significance since my participant number (34; I really struggled to get that many so it wasn't lack of effort) was too small a sample size to derive anything conclusive from it. Fair enough, made sense as some of my categories would have only had, for example, 2 people in them and obviously you can't test for significance with only 2 people. She then told me to do a paired T test on my sugar data, then on my sweetener data and compare the two, and also told me that instead of looking at individual sugar v sweetener response, to instead find the average of each time point over all participants and do a paired t test on the averaged readings per trial time point, not on each individual reading. Again, that made sense since I was looking for an overall effect since every one has a different metabolism so individual analysis wouldn't be likely to show any real results, it would just show that one person's particular reaction, not if sweeteners elicited a glucose response in general. So again, what the module leader advised made sense so I did my testing as she told me to.
I've just received my diss mark and feedback today. I got 63 which is decent so I'm fairly happy, but my feedback told me my results section was poor and the reasons why directly contradict the advice I was given. It was my supervisor who marked my diss and she said I should have used a 'more appropriate' test than a t test - but that's what I was told to do - and that I should have tested my demographics BECAUSE of my small sample size - again, I was told NOT to test them because I didn't have enough for significance. The rest of my feedback was small things like forgotten italics once so I really feel the majority of the marks I lost were in my results and I want to know why.
Am I wrong to feel a bit cheated here? I'm not angry at my supervisor but I feel like either I was given really bad advice by the module leader which directly impacted my grade (I appreciate we're supposed to learn independently but the point of supervisors/lecturers is to guide you and give you good, reliable advice when you're struggling), or my supervisor doesn't understand stats enough and has marked me down wrongly - but this seems unlikely as it has been second marked and surely any mistakes by my supervisor would have been noted and corrected?
Should I bring this up? I'm not even challenging my grade, but I want to know why there appears to be such a contradiction in the advice I was given vs the feedback I got as it does seem like I lost marks for my results.