These do look like wasps, yes, but there are hundreds of wasp species in Maryland so ID can be challenging. Our best guess based on body shape and patterning is the Noble Scoliid Wasp. The linked page provides images for comparison. Their larvae prey on the grubs of scarab beetles (the group to which pests like Japanese Beetle belong). Between this trait and their pollination services, they are considered a beneficial insect.

Miri