asyd.net

# Comment the following line :
#other  auth required           pam_unix_auth.so.1
# Add these two lines:
other   auth binding            pam_unix_auth.so.1 server_policy
other   auth required           pam_ldap.so.1

You probably need to do the same change for passwd entry. (Other is for daemon like ssh)