You could continue doing what you are doing and you will learn how to find the bait better. You likely drove past bait in your previous trips without finding it
You could also go out at night, skip looking for bait and start fishing lures/flies around structure. Places with rocks and current will keep you busy fishing and catching instead of looking for bait. It isn't for everyone, but it is an option...
