The absurdity of infinite regression is easily seen in the analogous absurdity of the ball that will never reach you. A ball thrown at you must first make it half way to you. It then makes it half way between that point and the thrower, and then to the half way point between that point and the thrower again. There is never a point at which the half way point is negated, no matter how small it is, thus the ball will never get to you. … It is when they catch the ball that infinite regression is refuted, if they were interested in a truthful answer in the first place.
Another answer is that nothing causes itself. This is seen in God’s Creation (Rom 1:20) and is applied to God as the source of, and basis for, causes and causation. The problem is that today’s mechanistic and materialistic basis for truth is deficient and cannot attain the true metaphysical causality known in the full Aristotelian sense. Causality is seen through the deficient mechanistic philosophy and it causes its own absurdities, like Dawkins’ “bowling ball appearing out of nowhere” view of causality written about in “The God Delusion”.
Where this ends, I think, is that no one will be given an answer that will convict them to believe. The proof they seek, and know they will not find, is one of force, a proof of 2+2=4 related to God. It is just not that way in this world, and they will accept absurdity before they accept God. It isn’t up to us to convert or convince them, but to remain faithful, truthful, and giving in charity because our answers to their inanities happen only seldom, but God’s answers to them are rejected continuously and at deeper levels than we can ever influence. The prayer and sacrifice for those whom God wills for us to help is infinitely more efficacious than intellectual sparing, even with those mental midgets faithful to regressive absurdities.