Thanks to Dev Adventures for this one.
I had one of the most annoining Windows XP issue. It happened while building a py2exe project on Windows Vista, and installing it on Windows XP.
The issue, a most cryptic error message:
"The procedure entry point _except_handler4_common could not be located in the dynamic link library msvcrt.dll"
Remove the mswsock.dll from the distribution.