Revealing the drivers of CO-to-H2 conversion factor variation and its impact on star formation efficiency across nearby galaxies