IF you could create a wormhole (a sort of link between two points in space and time) you could only create it with a point in the future. Basically, if you can't travel to a time before you could travel in time. There is also the idea of travelling at relativistic speeds which would slow your view of time down relative to a person in our time frame (e.g. what might take us 10 years could take someone in a relativistic rocket 1) so you could 'travel' into the future but you couldn't come back.
Both these things are purely theoretical and extremely unlikely to ever be a possibility.
To summarise: no, you can't travel through time except at the rate of one second per second.