Advocacy groups that think it’s a waste of money to build transit or bicycle infrastructure often argue that since gas taxes come from drivers, so should all transportation funding.
This chart from Pew shows where the transportation money comes from; it’s not all drivers:
Basically, the bluish areas are revenues which come specifically from drivers: gas taxes, vehicle taxes, and tolls. The greenish ones are other revenues: property taxes, general fund transfers, and other funds.
Some of the gas tax money goes to transit operations as well, but the vast majority doesn’t:
Thanks to Matt Yglesias at Vox for pointing out this chart and the report.