To make DSWeb console work properly on 64-bit servers 32 bit compatibility should be enabled. If it is not done automatically please follow the below steps.
For 2003 X64 servers:
Run the following command to make sure 32bit .net is installed.
Enable 32bit mode in IIS.To enable IIS 6.0 to run 32-bit applications on 64-bit Windows server, do the following.
a. Open a command prompt and navigate to the %systemdrive%\Inetpub\AdminScripts directory.
b. Type the following command:
cscript.exe adsutil.vbs set W3SVC/AppPools/Enable32BitAppOnWin64 "true".
c. Press ENTER
For 2008 X64 servers [only if DSWEB is not working]:
Enable 32bit mode in IIS.To enable IIS 7.0 to run 32-bit applications on 64-bit Windows server, do the following.
a. Go to IIS 7.0 manager.
b. Right click on the "Classic .NET AppPool" and "DefaultAppPool" in Application Pool and select "Advanced Settings" or select the same from the Actions pane after selecting the Application pool
c. Change the "Enable 32-bit Applications" to True (if you want the application pool to spawn in a 32-bit mode).
d. Click OK.
DSWeb console will works fine with default configuration settings in Windows 2008 R2 with IIS 7.0.