Please install the version identical to your Office installation.

If using Office in the 32-bits version, then you should install the 32-bits version of the CRM Plugin.
If using the 64-bits Office installation; then download the 64-bits Outlook Plugin.