Yes, this is autumn olive, a foreign invasive plant. They should all be removed as soon as possible as they crowd out native plants that our native wildlife need to survive. (This was not originally grown here as food, but as a "good" shrub for birds.  Bad idea.  Birds spread the seeds far and wide, and they are producing berries now, so should be eliminated before the birds can do so.)

Here's help: https://extension.umd.edu/hgic/topics/autumn-olive

Ellen