It is fairly common, as @Jongarvey, has often argued, to see Image of God as “called for a purpose.” This might leave Adam the only one in God’s Image, but that (hopefully) would not leave those outside the Garde, without rights because they were not in God’s Image.
Well if we can’t agree on what the Image of God is, than NONE of us can ground universal rights on the Image of God.