Signature of Fermi-surface anisotropy in point contact conductance in the presence of defects