B
Beryllos
Guest
I just worked out how to save a complete thread, but it’s rather geeky, as in not user friendly. It is written in bash, a GNU/Linux scripting language. Here is an example that I used to download Change One Letter:
Each curl statement downloads 20 posts. The URL must be correct for the thread of interest. If the topic was not automatically closed (it’s still open), the grep comparison string should to be modified to some text which is unique to the last post. After I worked out this method, it took about 12 minutes to download all four of the Change One Letter threads.
Sorry about the rough code.
Code:
for i in $(seq -w 1 20 12000)
do
curl "https://forums.catholic-questions.org/t/change-one-letter/453921/$i" > COL1-$i.html
grep "This topic was automatically closed" COL1-$i.html;
if [ "$?" -eq 0 ]
then
break
fi
done
Sorry about the rough code.
Last edited: