Scraping websites and bot-protection

Author: Nicolas Frankel

Original post on Foojay: Read More

The levels of bot protection I met while scraping genealogy sites, from a bare curl to shell-launched Chrome, and how to get past each one.