I don't think so. I've gone to church all my life and every church i've been to/visited has always had quite a lot of people in the congregation.
There are some churches around that are emptyish obviously. Eg like if a bad vicar has driven all the people away to other churches, or it's in a really rural area, or it's really old fashioned and mainly full of old people and the church goers arent being replaced when the older people die etc.
The statistics on church attendence arent very accurate btw, as it's only churches who belong to denominations like church of england etc that are required to send annual details about their congregations (like how many people attend or are church members etc), and it's those kind of churches that are declining the most due to the old fashioned way of doing things (not all of them are old fashioned though, as for example the church i go to is church of england but the evening service is full of students and people in their 20s, and the church is run by people in their 20s and 30s and is nothing like the fancy boring church of england churches that are around). Free churches/non-denominational ones are the ones that seem to be increasing and gaining a lot more people in recent years, yet they dont have to send in the statistics about themselves, so arent represented in the official statistics. Which could lead to this myth that churches are empty on sundays.
So i'd say the majority of churches seem to have quite a lot of people in them, and not just on sundays. As many churces now run things like cafes and children's groups during the week, so there's usually people attending for all kinds of reasons.