Getting to grips with the wonder that is GPO
Try this to delete local user accounts:
Create a new GPO, and go to Computer Config > Preferences > Control Panel Settings > Local Users and Groups. Right click, and choose New > Local User. In the next window, choose Delete as the Action type, and then type in the name of the user to delete.