Characterization and Modeling of Contamination for Lyman Break Galaxy Samples at High Redshift