If you've got the purple from him, then this is sort of a big deal. If you're a blue or white then not that big. LOL @ a stripe, come on. I've found that it's very difficult for certain people to not take this personally. A lot of people saying it's not a big deal, but just wait and see if that holds true. I doubt it, but there are a few exceptions sometimes.
A lot of instructors, even if it's completely legit find it as, "this student isn't doing that well and blames me for not teaching well enough and instead should be blaming himself because he doesn't work/try hard enough. So he thinks the grass is greener over the next hill when it's his own fault. Couldn't possibly be my teaching. How could it be and how could Joe X know? He's a white or blue belt.)
I think it's just in people's nature to take offense to someone leaving and be defensive about it. This is much more true in bjj because we form a lot of tight bonds from working, sweating, and rolling together. I don't think that happens as much doing katas together. In BJJ, it's much worse so than in other martial arts IMO and experience. This is why a lot of people that just don't like where they are training at will come up with a couple bs legit reason (not that the TS'ers is, not saying that at all).
Just tell him your leaving and why and just be cordial after that. Life changes for all of us and it can either work out or not. Despite what anybody says, membership to a bjj club or academy becomes a lot more than just paying a membership fee after a year or two or three. Good luck and stick to your guns and no matter what, be cool and nice.