Hi all! Curious if anyone knows of a headless web browser solution, similar to Puppeteer, that can be used in conjunction with Erlang to navigate dynamic websites and scrape specific information.
I have to access a website that contains MFA and enter specific information into various fields, then scrape specific results at scale, and I’m trying to come up with a better way to manage each scraping instance, rather than creating multiple EC2 machines.
Any insight would be greatly appreciated!