Data Annotation Project Manager

Iterative Health is pioneering the use of artificial intelligence-based precision medicine in gastroenterology, with the aim of helping to optimize clinical trials investigating the treatment of IBD. We use advanced machine learning and computer vision to interpret endoscopic videos and other data types to help clinicians better assess patients with potential GI conditions. Iterative Health aims to establish more meaningful clinical endpoints that are better as predictors of both therapeutic response and disease outcomes.

Iterative Health is seeking a Data Annotation Project Manager. This dynamic, fast-paced role will require experience with leading medical image annotation initiatives, biomedical science knowledge, and strong attention to detail and documentation.  A successful candidate will work cross-functionally with a diverse team of machine learning engineers, clinical experts, and product managers to solve challenging real-world scientific problems that have a company-wide impact. The leader in this role will be responsible for a team of 20+ annotators in charge of delivering high-quality image and video annotations, including but not limited to classification and detection tasks.

What you’ll be doing:

• Work cross-functionally with Machine Learning, Product, and Scientific teams from ideation to production phases of various medical image annotation initiatives.
• Collaborate closely with stakeholders to develop precise project specifications and determine suitable datasets for model training, validation, evaluation, and regulatory submissions.
• Ownership of annotation efforts, ensuring they align with product requirements, meet compliance obligations, and are completed efficiently.
• Monitor, evaluate, and mitigate risks across all data annotation workflows by establishing and tracking quality metrics for annotation tasks.
• Present findings and insights to stakeholders at different levels.
• Oversee operational logistics, including resource forecasting and capacity planning, by managing the annotation leads and individual annotators.
• Detail-oriented in data sourcing, creating training/evaluation contents, onboarding annotators, and conducting assessments while ensuring adherence to data governance and compliance standards.

Required Skills:

• Over 2 years of experience in data annotation, data operations, or related fields, including at least 1 year in leading annotation teams.
• Detail-oriented with experience reviewing documentation and quantitative/qualitative work, in addition to being responsible for reviewing the work of others to ensure accuracy, completeness, and consistency with standards.
• Knowledgeable about machine learning team operations and annotated data in model training.
• Hands-on experience with data annotation platforms such as Encord, LabelBox, Scale AI, Supervisely, etc.
• Strong communication, documentation, organization, and project management skills.
• Experience collaborating with cross-functional teams in a dynamic, fast-paced startup environment.

Preferred Skills:

• Experience with
  • Encord Annotation platform
  • Training and Learning Management Systems (e.g., LearnUpon, Docebo, iSpring, etc.)
  • QuickBase
  • Electronic Health Records
• Working knowledge of Gastroenterology, particularly
  • GI polyps and colorectal cancer
  • Inflammatory bowel disease (IBD)
• Regulated medical device and FDA submissions