All perfect praise be to Allah, The Lord of the Worlds. I testify that there is none worthy of worship except Allah, and that Muhammad is His slave and Messenger.
What you mentioned is not at all Shirk; Allah Says (what means): {Say, "Who has forbidden the adornment of Allah which He has produced for His servants and the good [lawful] things of provision?".} [Quran 7:32]
If a man beautifies himself, applies perfume, and cleans himself when he attends ceremonies and the like, then this is among the permissible matters, and he may be rewarded for that if he intends to follow the Sunnah and so forth.
The Prophet said: “A man likes that his clothes look nice and his shoes look nice. This is not pride. Allah is beautiful and He loves beauty.” [Muslim]
However, one should wear proper attire and beautify himself when going to the mosque as well, as Allah Says (what means): {O children of Adam, take your adornment at every masjid.} [Quran 7:31]
However, if a person beautifies himself more when going to other than the mosque, then this is not a sin, let alone it being Shirk.
Your question is a result of whispers and we fear that you are afflicted by it. Hence, you should beware of whispers and do not get carried away with them, as being carried away with whispers leads to a great evil.
Allah knows best.