Experienced Web Scraping Engineer - Python (Remote)

In this role, you’ll:

• Develop scalable scrapers.
• Define resilient scraping strategies, unblock websites for scrapingImprove observability in the system.
• Develop back-end solutions for scraping & parsing problems of various magnitudes.
• Maintain the current system and develop new features related to scraping & parsing.

• Experience working with Python.
• Understanding of computer science, including data structures, algorithms, computability and complexity.
• Version Control skills using Git.
• Knowledge on how to unblock websites for scraping.
• Is able to use different scraping techniques & open-source tools to build scrapers.
• Is comfortable with using Dev Tools.
• Network (TLS/SSL) knowledge.
• Worked with browser automations.
• Knows their way around asynchronous programming.

Nice to have

• Web development knowledge.
• Knows how to use CSS Selectors / XPaths for parsing.
• Experience working with Go & C++.
• Worked on browser source code.
• Knowledge of any front-end framework.
• Experience working with Pydantic, FastAPI, SQLAlchemy.
• Has experience working with Redis, MySQL, Docker, Kubernetes, Elasticsearch, Kibana and monitoring tools like Grafana, Prometheus.
• Experience with machine learning that is scraping domain-specific.
• Has experience in building scalable systems.