This plant is clearly in the apple family, not blueberry. Probably mis marked at the store. Sorry, it is very hard to tell exactly what type of Apple. My first thought, since the fruits are so small, was that it was a crab apple (ornamental) but since you bought it as a fruit bearing plant, I'm wondering if it might be another strain? Hard to tell.

Thank you, Rebecca, for your prompt response.  I guess I should have remembered the old saying "You get what you pay for."  I wanted to send you a little more information.  I am attaching another photo.  I noticed that the fruit on this bush is clustered in threes.  The size of each is about the size of a quarter.  Also, each branch has lots of short, spiky shoots on them. 

Again, I am sticking with Crab Apple-- but it is so hard to tell which one.  There are some larger fruited varieties that were used to make jams and jellies.  I will send this question to one of our fruit experts to see what they say.  Hopefully, they will be able to tell.  Thanks again for the question.

I agree that this is probably a crabapple.   The other choice is hawthorn, but the leaves are more like crabapples.   Most of the typical crabapple varieties sold by nurseries do not have thorns, but the wild ancestors of these commonly do.  
Based on the picture it appears that your crabapple is a vigorous upright growing tree, which will be likely be a problem if it is close to the house.  It is hard to judge how close the tree actually is, based on the picture.