Physical processes driving barrier island change during storms are important to understand to mitigate coastal hazards and to evaluate conceptual models for barrier evolution. Spatial variations in barrier island topography, landcover characteristics, and nearshore and back-barrier hydrodynamics can yield complex morphological change that requires models of increasing resolution and physical complexity to predict. Using the Coupled Ocean-Atmosphere-Wave-Sediment Transport (COAWST) modeling system, we investigated two barrier island breaches that occurred on Fire Island, NY during Hurricane Sandy (2012) and at Matanzas, FL during Hurricane Matthew (2016). The model employed a recently implemented infragravity (IG) wave driver to represent the important effects of IG waves on nearshore water levels and sediment transport. The model simulated breaching and other changes with good skill at both locations, resolving differences in the processes and evolution. The breach simulated at Fire Island was 250 m west of the observed breach, whereas the breach simulated at Matanzas was within 100 m of the observed breach. Implementation of the vegetation module of COAWST to allow three-dimensional drag over dune vegetation at Fire Island improved model skill by decreasing flows across the back-barrier, as opposed to varying bottom roughness that did not positively alter model response. Analysis of breach processes at Matanzas indicated that both far-field and local hydrodynamics influenced breach creation and evolution, including remotely generated waves and surge, but also surge propagation through back-barrier waterways. This work underscores the importance of resolving the complexity of nearshore and back-barrier systems when predicting barrier island change during extreme events.