That's the thing - Dean doesn't want to adjust to this kind of life, to play house in a camp where he can't call the shots or get the information that he needs.

He doesn't want to get comfortable. Too much adjustment leads to a false sense of security, which can get a guy killed.

Dean doesn't answer the question.

"Don't worry about what I'm gonna do." Since he's sure Sam will have something to say about it, regardless.

With that, he starts waking away.