Surah 10. Yunus, Ayah 29

Thus the Qur'an makes it clear that the saints and prophets who, after their death, have been unwarrantably deified by their followers shall not be held accountable for the blasphemous worship accorded to them (cf. {5:116-117}); furthermore, even the inanimate objects of false worship will symbolically deny any connection between themselves and their worshippers.

See last note. They did not even know that they were being falsely worshipped in that way.