I don't think you can remove them until the system catches up to them but you can make them hidden in Store > Edit Items. Once you do that they should be invisible to the Store and won't show up in the Store Window.
When you block a person, they can no longer invite you to a private message or post to your profile wall. Replies and comments they make will be collapsed/hidden by default. Finally, you'll never receive email notifications about content they create or likes they designate for your content.
Note: if you proceed, you will no longer be following .