The swastika predates the Nazis by forever (at least as far back as 1500BC) and shows up a lot in odd places. There's an old pre-1900 mansion near where I live that has them all over in the tile work. Look at the end of the "Uniforms and distinctive insignia" section here:
http://en.wikipedia.org/wiki/Scouting
I understand why the German's don't want it flashed around but sometimes they carry it to excess (by my standards) including things like not showing up in historical based games.
And then there's the question of why children don't show up in European RPGs. . .
The point is different societies have different standards. We may not agree with them but, well, there they are.