Sulfur is less electronegative, which would decrease the acidity. However, the bond between sulfur and hydrogen is weaker than that of oxygen and hydrogen (because sulfur is larger) and the negative charge is spread over a larger area as you said. The electrons already on sulfur can largely be ignored - only the negative charge is relevant to stability because that's what would react.