I may say that when I was a young man and was debating these questions very seriously in my mind, I for a long time accepted the argument of the First Cause, until one day, at the age of eighteen, I read John Stuart Mill's Autobiography, and I there found this sentence: "My father taught me that the question 'Who made me?' cannot be answered, since it immediately suggests the further question `Who made god?'" That very simple sentence showed me, as I still think, the fallacy in the argument of the First Cause. If everything must have a cause, then God must have a cause. If there can be anything without a cause, it may just as well be the world as God, so that there cannot be any validity in that argument.
From his article Why I Am Not A Christian.