Touching or wiping the الكعبة's cloth (Kiswah), its walls, or its corners — other than the الحجر الأسود and the Yemeni Corner — has no basis in the السنة and is considered an innovation by the majority of scholars. النبي (صلى الله عليه وسلم) only performed istilam (ritual touching/kissing) of the الحجر الأسود, and he would touch the Yemeni Corner with his hand without kissing it. He deliberately did not touch the other two corners (the Iraqi and Shami corners) or the walls of the الكعبة.
الشيخ ابن باز stated that many الحجاج mistakenly rub the الكعبة's cloth on their bodies, wipe their faces against the walls, or press their chests against the cloth believing it carries blessings (barakah). None of this was practiced by النبي, and it has no basis in authentic evidence. The blessings of the الكعبة are in performing الطواف around it, praying near it, and making دعاء facing it — not in physical contact with its cloth or walls.
Sheikh الألباني emphasized that النبي, who loved the الكعبة more than anyone, only touched the الحجر الأسود and the Yemeni Corner. When Umar ibn al-Khattab kissed the الحجر الأسود, he said: 'I know that you are a stone and can neither benefit nor harm. Had I not seen the Messenger of Allah kissing you, I would not have kissed you.' This demonstrates that the touching is purely an act of following the السنة, not a belief that the stone itself holds power or blessings.