I don't know Desktop.ini, but I don't think it has anything to do with your problem. A registry entry points to %PUBLIC%\Desktop, but that reference cannot be resolved on your computer.
Maybe we need to dig a bit deeper; open again Windows Explorer, and this time just type %PUBLIC% in the address bar: do you get a list of items, like Libraries, Public Desktop, Public Documents, etc.?
