Thanks for the great pictures. You most likely have the common or creeping Bellflower, Campanula rapunculoides, an aggressive perennial plant often called invasive, especially if you don't want it. You may already have found that it is difficult to eradicate. Pulling, digging and chemical control is difficult. It is resistant apparently, to lawn broadleaf treatments.  If you have the time and energy to pull and dig, especially if your area is small, that will help. Otherwise, glyphosate can be effective but may require several applications. Caution: everything nearby when glyphosate is applied may be killed. If you do choose to use glyphosate, PLEASE  read and follow the directions for your safety and that of the surrounding plants. I have some at the back of my yard in a wild area and the purple bell shaped  blooms are pretty, keeping it there is tricky. Good luck!

Thank you so much! I am sure that's what it is, as in some places in the landscaping it has gotten flowers and that's what they look like - I just hadn't mentally connected the spring leaves with the tall upright purple flowers. Apparently it is edible, which makes it the earliest green available in my garden. It looks like I have a lot of work to do to get it under control!

You are most welcome, so glad I could help!  Happy Gardening!