2003 Dodge Caravan shuts off while driving

I have a 2003 Dodge Caravan v6 3.3L that has been having a few issues. First it started to hesitate while accelerating and occasionally stalling out @ stop lights. It also started getting bad gas millage during this time. That sort of went away, then a week ago the engine would shut off while driving. If I was able to get it restarted it would repeatedly shut off until I reached my destination. Now, I can drive it to work in the morning with no issues, leave it sit the whole day, then drive home (about 20min) also, with no issues. If I try to go somewhere after I get home from work, that it where the problems begin.