Strong experience with LangChain for building and managing LLM chains and agents., Familiarity with LLM response evaluation techniques, both metric-based and human-in-the-loop., Experience using Pydantic or similar tools for response formatting and validation., Strong communication skills and experience working in client-facing roles..
Key responsibilities:
Design, refine, and deploy LLM-powered applications that align with business goals.
Collaborate with clients and internal teams to iterate on models and ensure performance standards are met.
Lead efforts in fine-tuning LLMs to meet domain-specific needs and improve performance.
Serve as a key client-facing resource, translating complex Gen AI strategies into actionable insights.
Report This Job
Help us maintain the quality of our job listings. If you find any issues with this job post, please let us know.
Select the reason you're reporting this job:
Lean Tech is a rapidly expanding organization situated in Medellín, Colombia. We pride ourselves on possessing one of the most influential networks within software development and IT services for the entertainment, financial, and logistics sectors. Our corporate projections offer many opportunities for professionals to elevate their careers and experience substantial growth. Joining our team means engaging with expansive engineering teams across Latin America and the United States, contributing to cutting-edge developments in multiple industries.
As a Gen AI Engineer, you will work at the forefront of artificial intelligence, developing advanced solutions with large language models (LLMs) to solve business challenges and optimize outcomes.
Position Title: Senior Gen AI Engineer
Location: Remote - Colombia
What you will be doing:
The Senior Gen AI Data Scientist, you will be responsible for designing, refining, and deploying LLM-powered applications that align with business goals. You will collaborate directly with clients and internal teams to iterate on models and ensure outcomes meet performance and usability standards. Your responsibilities will include:
LLM Application Development: Build and manage chains and agents using frameworks like LangChain, including RAG retrieval, agentic RAG, Q&A chains, and memory management.
Response Evaluation: Apply evaluation techniques including automated metrics and human-in-the-loop feedback to refine model outputs.
Model Iteration and Tuning: Lead efforts in fine-tuning LLMs to meet domain-specific needs and improve performance.
Output Alignment: Ensure model outputs align with defined business objectives and KPIs.
Response Formatting: Leverage response formatting tools and standards such as Pydantic to structure LLM outputs efficiently.
Content Retrieval: Implement advanced retrieval methods including semantic, hybrid, and multi-modal search techniques.
Client Interaction: Serve as a key client-facing resource, translating complex Gen AI strategies into actionable insights and business value.
Requirements & Qualifications
To excel in this role, you should possess:
Strong experience with LangChain for building and managing LLM chains and agents
Familiarity with LLM response evaluation techniques, both metric-based and human-in-the-loop
Experience using Pydantic or similar tools for response formatting and validation
Knowledge of content retrieval techniques such as semantic search, hybrid search, and multi-modal retrieval
Experience in model fine-tuning and iterative development for real-world business scenarios
Ability to align model performance with clearly defined business goals
Strong communication skills and experience working in client-facing roles
Desired Skills:
Experience integrating Gen AI applications in production environments
Familiarity with LLM performance monitoring and drift detection
Ability to explain complex Gen AI workflows to non-technical stakeholders
Knowledge of prompt engineering best practices and few-shot learning techniques
Why you will love Lean Tech:
Join a powerful tech workforce and help us change the world through technology
Professional development opportunities with international customers
Collaborative work environment
Career path and mentorship programs that will lead to new levels.
Join Lean Tech and contribute to shaping the data landscape within a dynamic and growing organization. Your skills will be honed, and your contributions will be vital to our continued success. Lean Tech is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
Required profile
Experience
Industry :
Information Technology & Services
Spoken language(s):
English
Check out the description to know which languages are mandatory.