There are several very memorable moments in this movie - first of all, the scene in the field with the frightening "zombie-like" native leading the main character to the center of voodoo worship. The images are dream-like and extremely haunting.
The film really is a great study for subtle horror. All the really frightening stuff is in the various subtexts - this fantastic set-up makes an contention of the two brothers over the dinner table at least as chilling as the more "traditional" tricks of the trade to frighten the audience. Another masterpiece from Tourneur, whom I've obviously neglected to admire so far. His salient ability seems to be to swathe ordinary tension with hidden meaning, as far as I've noticed. Definitely worth seeing more of.