Join EarnIn as a Gen AI Contractor to enhance LLM-powered chatbot systems in a hybrid work environment.
Posted by employer 3 days ago
First seen on Joblaze 3 days ago
Last verified on the company career page 3 days ago
What you'll build
- Build and run evaluations for LLM-powered chatbot systems
- Support design and calibration of LLM-as-judge scorers
- Contribute to conversation simulation and replay infrastructure
- Assist with real-time observability tooling
- Analyze production conversations for insights
Must have
- Currently pursuing a Bachelor's or Master's degree in Computer Science or related field
- Familiarity with Python
- Comfort working with APIs, data pipelines, or scripting
Nice to have
- Basic understanding of NLP concepts
- Hands-on experience with LLMs
- Strong understanding of probability theory and stochastic systems
Practical constraints
- Requires two days a week in-office
AI in the day-to-day
Help build and run evaluations for LLM-powered chatbot systems.
Requirements
- Education
- Bachelor's degree
Not disclosed in this posting: compensation, seniority, years of experience, visa sponsorship.
Joblaze summary
The Gen AI Contractor at EarnIn plays a crucial role in enhancing the performance of LLM-powered chatbot systems through evaluation-driven development. This position requires skills in Python, familiarity with APIs, and a foundational understanding of NLP concepts, making it suitable for candidates pursuing degrees in computer science or related fields. The role is ideal for individuals who are analytical, self-directed, and eager to contribute to the development of reliable AI systems. Earnin's focus on building a diverse team reflects its commitment to creating a financial system that serves everyday people.
Joblaze insights
Quick facts
- Is the Gen AI Contractor role remote?
- It's hybrid — Earnin expects some on-site time in Bengaluru, India.
- Where is the role based?
- Earnin is hiring for this position in Bengaluru, India.
- What's the tech stack?
- Joblaze extracted these technologies from the posting: LLM, NLP, Python.
- Is this full-time or contract?
- Contract for this Gen AI Contractor role at Earnin.
From the original posting
About EarnIn
POSITION SUMMARY
EarnIn's Gen AI Team is on a mission to deliver the best agentic experience for our customers — accurate, fast, and set up for success. At the heart of that mission is Evaluation-Driven Development (EDD): a closed loop of human judgment and calibrated LLM scorers that lets us ship new chatbot capabilities with confidence, measure performance in real time, and tie every change to business outcomes.
To help us execute on this vision, we are hiring a Gen AI Contractor for the Analytics Engineering Team. This position is based in Bengaluru, India, requires two days a week in-office as part of our expanding site location, and is a 6-month contract engagement starting in January 2027.
WHAT YOU'LL DO
- Help build and run evaluations for our LLM-powered chatbot systems, contributing to our goal of making evals a standard practice across all teams at EarnIn
- Support the design and calibration of LLM-as-judge scorers, working closely with subject matter experts (SMEs) to align automated scoring with human ground truth
- Contribute to conversation simulation and replay infrastructure — a core building block of our automated research loop
- Assist with real-time observability tooling to detect chatbot performance degradation before customers feel it
- Help analyze production conversations and surface insights that drive chatbot improvements
- Work alongside ML engineers and analysts to iterate on prompt mutations, model changes, and evaluation pipelines
WHAT WE'RE LOOKING FOR
- Currently pursuing a Bachelor's or Master's degree (B.E., B.Tech, M.Tech, or equivalent) in Computer Science, Software Engineering, or a related field from an Indian university
- Genuine curiosity about large language models, AI evaluation, and building reliable Gen AI systems
- Familiarity with Python and comfort working with APIs, data pipelines, or scripting
- Basic understanding of NLP concepts or hands-on experience with LLMs (even through personal projects or coursework) is a plus
- Strong understanding of probability theory and stochastic systems is a significant plus
- Strong analytical thinking — you ask "how do we know this works?" before shipping
- Clear written and verbal communication; you can translate findings for both technical and non-technical audiences
- Self-directed and thorough — you take ownership, follow through, and don't leave things half-done
#LI-Hybrid
At EarnIn, we believe that the best way to build a financial system that works for everyday people is by hiring a team that represents our diverse community. Our team is diverse not only in background and experience but also in perspective. We celebrate our diversity and strive to create a culture of belonging. EarnIn does not unlawfully discriminate based on race, color, religion, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), gender identity, gender expression, national origin, ancestry, citizenship, age, physical or mental disability, legally protected medical condition, family care status, military or veteran status, marital status, registered domestic partner status, sexual orientation, genetic information, or any other basis protected by local, state, or federal laws. EarnIn is an E-Verify participant.
Standard company text repeated across Earnin's postings is omitted here.
Similar positions
Explore more