Data Pipeline Expert for Search

Why does MWDN rock?

MWDN connects exceptional tech talent with leading companies across Israel, the USA, Great Britain, and Western Europe. We aim to ensure our employees enjoy a rewarding and secure experience while collaborating with prestigious international clients.

Here’s what you can expect when you get employed by MWDN:

• Security first. We vet our clients to eliminate risks, ensuring reliability and timely payments for your hard work—no fraud or unforeseen events here!
• Career support. If a match isn't right, we're here for you. We actively assist our employees in finding new opportunities that fit their skills and aspirations.
• Legal assistance. We provide guidance on legal matters (e.g., opening and administering your private entrepreneur account, taxes, army enrollment, etc.).
• Professional development. We offer English courses and other engaging activities, including team-building events.

Why choose us? MWDN is ranked among the top 5 IT employers in our region by DOU, and we pride ourselves on our transparency and commitment to our team. Curious to learn more? Discover what our employees say about us in their DOU reviews: MWDN reviews.

What is your new project?

Domain: Web data

Location: Florida (USA)

Company size: 11-50 employees

Founded in: 2020

What makes this project exciting?

Our client is at the forefront of data intelligence, providing 800M+ B2B profiles to fuel SaaS, AI/ML, and Sales Tech platforms.

Their data solutions power industry leaders in Talent and Sales Intelligence, ensuring they stay ahead with the freshest and most complete datasets.

What makes you a great fit

Technical Skills:

• Proficiency in data pipeline technologies and frameworks (e.g., Apache Kafka, Apache Spark, Apache Flink, Airflow)
• Strong programming skills in languages such as Python, Java, or Scala
• Experience with distributed data storage and processing systems (e.g., Hadoop, Elasticsearch, Solr, cloud-based data warehouses like BigQuery, Snowflake, Redshift)
• Expertise in data modeling, schema design, and data transformation techniques
• Knowledge of search engine indexing and query optimization principles
• Experience with cloud platforms (e.g., AWS, GCP, Azure) and their data services
• Familiarity with data serialization formats (e.g., JSON, Avro, Parquet)
• Experience with containerization technologies such as Docker and orchestration tools such as Kubernetes

Experience:

• Proven experience in building and managing large-scale data pipelines for search applications
• Experience working with diverse data sources and formats
• Demonstrated ability to optimize data pipelines for performance and scalability
• Experience with real time data ingestion

Soft Skills:

• Strong problem-solving and analytical skills
• Excellent communication and collaboration skills
• Ability to work independently and as part of a team
• Strong attention to detail
• Ability to learn new technologies quickly

Your day-to-day in this position

• Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and indexing massive datasets (structured and unstructured) to enable efficient search.
• Optimize data pipelines for performance, reliability, and real-time or near real-time updates.
• Implement data quality checks and monitoring to ensure data integrity throughout the pipeline.
• Collaborate with search engineers and data scientists to understand search requirements and translate them into pipeline specifications.
• Troubleshoot and resolve pipeline issues, including data inconsistencies and performance bottlenecks.
• Document pipeline architecture, design, and implementation details.

Why work with us?

• People-oriented management without bureaucracy.
• The friendly climate inside the company is confirmed by the frequent comeback of previous employees.
• Paid time off (18 working days per year, plus all national holidays and 9 sick days).
• Flexible working schedule.
• Full financial and legal support for private entrepreneurs.
• Free English classes with native speakers or with Ukrainian teachers (for your choice).
• Dedicated HR.

Our next steps

✅ Submit a CV in English — ✅ Intro call with a Recruiter — ✅ Client's technical interview — ✅ Final Interview — ✅ Offer