Before Islam, in the period Muslims call the Jahiliyyah (the age of ignorance), idol worship in Arabia took many forms. Whenever a caravan left Makkah, its people would chip a piece of rock off the Ka'bah and take it with them to worship as an idol. In Islam, the bricks of the Ka'bah were never sacred in themselves, since the building has been rebuilt many times. What is sacred is the land of Makkah. One companion recalled that when travelers in the desert could find no rock, they would pile up sand, squeeze goat's milk over it to make it firm, and walk around it in worship (tawaf).
One of the worst stories is that of the idols Na'ila and Isaf. Na'ila stood on the hill of Safa and Isaf on the hill of Marwa. The Quraysh would touch them as they walked back and forth between the two hills in sa'i. The history books say that Na'ila and Isaf had been two lovers who could find nowhere to be alone except inside the Ka'bah, and they were intimate there. As a punishment, Allah turned them to stone on the spot. The Quraysh took this for a miracle and set them up on Safa and Marwa.
When Islam came, the early Muslims felt uneasy about performing sa'i because of these idols. Allah then revealed that Safa and Marwa are among His signs (Qur'an 2:158). This assured them that the hills were holy long before Na'ila and Isaf, and had nothing to do with them.
The Quraysh also believed that the angels were Allah's daughters, and they worshiped the angels for that reason. By the time the Prophet ﷺ conquered Makkah, about 360 idols stood around the Ka'bah. Some had human shapes, some were animals, and many were half human and half animal. Muslims share one set of core beliefs, the Pillars of Faith (Arkan al-Iman). The pagan Arabs had no such shared creed, and different people believed different things about the idols. The one thing they all agreed on was that worshiping idols brought them closer to Allah.