Touching or wiping the কাবা শরীফ's cloth (Kiswah), its walls, or its corners — other than the হাজরে আসওয়াদ and the Yemeni Corner — has no basis in the Sunnah and is considered an innovation by the majority of scholars. নবী করীম (সাল্লাল্লাহু আলাইহি ওয়া সাল্লাম) only performed istilam (ritual touching/kissing) of the হাজরে আসওয়াদ, and he would touch the Yemeni Corner with his hand without kissing it. He deliberately did not touch the other two corners (the Iraqi and Shami corners) or the walls of the কাবা শরীফ.
Sheikh Ibn Baz stated that many হাজীগণ mistakenly rub the কাবা শরীফ's cloth on their bodies, wipe their faces against the walls, or press their chests against the cloth believing it carries blessings (barakah). None of this was practiced by নবী করীম, and it has no basis in authentic evidence. The blessings of the কাবা শরীফ are in performing তাওয়াফ around it, praying near it, and making dua facing it — not in physical contact with its cloth or walls.
Sheikh Al-Albani emphasized that নবী করীম, who loved the কাবা শরীফ more than anyone, only touched the হাজরে আসওয়াদ and the Yemeni Corner. When Umar ibn al-Khattab kissed the হাজরে আসওয়াদ, he said: 'I know that you are a stone and can neither benefit nor harm. Had I not seen the Messenger of Allah kissing you, I would not have kissed you.' This demonstrates that the touching is purely an act of following the Sunnah, not a belief that the stone itself holds power or blessings.