Match score not available

Web Automation Engineer (Anti-Scraping)

extra holidays
Remote: 
Full Remote
Contract: 
Experience: 
Mid-level (2-5 years)
Work from: 

Offer summary

Qualifications:

3+ years experience in Python or Node.js/TypeScript development, Experience in web scraping or web automation, Understanding of HTTP protocol and browser APIs, Open-source development experience is a plus, Good communication skills in English.

Key responsabilities:

  • Research anti-scraping services and implement libraries
  • Utilize proxy services and human-like browser interaction
  • Manage sessions for web automation tasks
  • Collaborate with the team on project development
  • Engage in experiment-driven decision making
Apify logo
Apify Information Technology & Services Scaleup https://apify.com/
51 - 200 Employees
See more Apify offers

Job description

Apify's mission is to make the web more programmable ๐Ÿ’ป.

Why? Because we believe that humans have better things to do than fill in internet forms, compile Excel sheets of copy-pasted data, or watch thousands of videos to determine whether they include a specific brand logo. Those are jobs for a machine. And just as we have tools that make our lives easier in the real world, we should also have tools to make our lives easier on the web.

We use web automation to robotize unsubscribe flows to save people money, and we collect billions of rows of data from all over the world for sciencemarket research, or finding lost children.

Fortune 500 companies and small startups alike need this power to make great business decisions ๐Ÿš€.

To automate human activities on the web and proceed with our mission, we need robots that behave and act like real users, and this is where we need your help!

You will be part of one of our 5 product teamsโ€”the team that works on Apifyโ€™s open-source tooling loved by the community.

The team is led by Martin Adamek, co-author, and maintainer of Apifyโ€™s Crawlee and his own MikroORM framework.

You will research existing anti-scraping services and implement new open-source libraries or internal services to overcome them by utilizing various proxy services, browser fingerprinting methods, human-like browser interaction, session management, and others.

Our tech stack:

  • Frontend: React.js, styled-components, Storybook, Cypress
  • Backend: TypeScript/Node.js, Next.js, Nest.js, Docusaurus, Jest
  • Infra: AWS, Kubernetes, Helm, MongoDB, Redis, DynamoDB, S3, GitHub Actions...
  • Monitoring: New Relic, LogDNA, Sentry, PagerDuty
  • Tools: GitHub, ZenHub, Notion, GSuite
  • AI Tools: Langchain, LlamaIndex, Pinecone, OpenAI API, Web agents
  • Process: two-week sprints, code reviews, tests, automating whatever we can, deploying multiple times per day

You'll be a perfect match ๐Ÿ’œโž•๐Ÿ’œ if you have:

  • 3+ years of industry experience in Python or Node.js/TypeScript development
  • You have prior experience in web scraping or web automation
  • You are a hacker being able to solve unique, unprecedented challenges
  • You know how the web works, from HTTP protocol up to modern browser APIs to draw an SVG
  • Experience in open-source development is a plus
  • Experiment-driven and collaborative mindset
  • Good communication skills in English

Why should you work for Apify?

  • Space, support, and autonomy for personal growth, with a direct impact on our success
  • Full-time position in Prague at our office located in Lucerna Palace, Prague, or Impact Hub Brno ๐Ÿฐ
  • Option to work remotely ๐Ÿ›‹๏ธ
  • Flexible working hours (perfect for both night owls ๐Ÿฆ‰ and early birds ๐Ÿฅ)
  • Zero bullshit policy โ€“ No Jira, no Okta, no Confluence, no Certifiedโ„ขScrumMastersยฎ, no quarterly estimates. Just GitHub, GSuite, Notion, Slack, and shipping stuff to production
  • Nobody counts holidays as long as the work gets done ๐Ÿ’ช
  • Stock options and profit sharing ๐Ÿ’ฐ
  • We welcome pets, kids, and bikes at the office ๐Ÿ•๐Ÿ‘จโ€๐Ÿ‘ง๐Ÿšฒ
  • Epic team buildings and offsites ๐Ÿšข with biking, canoeing, and other adventures ๐Ÿช‚
  • Solid education and training budget, conference tickets, internal โ€œEat & Learnโ€ sessions, and the possibility to work across teams ๐Ÿ‘ฉ๐Ÿผโ€๐Ÿ’ป๐Ÿ‘จ๐Ÿฝโ€๐Ÿ’ป
  • Generous hardware budget ๐Ÿ’ป
  • Free lunches every day ๐ŸŒฎ๐Ÿฑ๐Ÿœ๐Ÿ•๐Ÿฅก
  • Unlimited supply of โ˜• & ๐Ÿบ and snacks
  • Free entry to the wonderful Prague Zoo ๐Ÿ˜
  • Ping-pong, chess, PS5, lightsabers, foosball league after lunch, free Multisport card, and so on

Hiring process

Intro call โ˜Ž๏ธ โ†’ Home assignment ๐Ÿง‘๐Ÿผโ€๐Ÿ’ป โ†’ Interview โœ๏ธ โ†’ Meeting with the team ๐Ÿ• โ†’ Offer ๐Ÿ“„


For more details about Apify and what it is like to work with us, see our Careers page.

Required profile

Experience

Level of experience: Mid-level (2-5 years)
Industry :
Information Technology & Services
Spoken language(s):
EnglishEnglish
Check out the description to know which languages are mandatory.

Other Skills

  • Problem Solving
  • Verbal Communication Skills
  • Collaboration

Test Automation Engineer Related jobs