The job centre really won't be bothered what you wear to appointments there. I did find, however, that they were always really nice to me when I was signing on, because I was polite and appeared to be making some sort of concerted effort to find a job. It's a pretty grim job for them, so just seem like you mean it, be pleasant, and try not to look frustrated even if you are, and you'll be fine.