We are looking for a high-taste Senior Software Engineer with a strong eye for quality and hands-on experience working with preference data, rubric creation, and evaluation workflows.
The ideal candidate is comfortable working in ambiguous, fast-moving environments, communicates clearly, and knows how to translate complex technical work into concise, actionable outputs. You should be comfortable shipping quickly while maintaining a high bar for engineering and data quality.
ResponsibilitiesDesign, refine, and iterate on rubrics and evaluation criteria for preference data.
Review and label data with a high bar for quality, identifying subtle issues and inconsistencies.
Build and maintain pipelines and infrastructure supporting data generation, collection, and evaluation workflows.
Analyze findings from data work and communicate clear recommendations, updates, and summaries.
Collaborate closely with researchers and engineers to translate qualitative judgment into scalable processes.
Work effectively in ambiguous and rapidly changing environments.
Contribute hands-on engineering solutions that improve data and evaluation workflows.
8+ years of professional software engineering experience.
5+ years of strong proficiency in Python and/or TypeScript.
Hands-on experience building or maintaining pipelines and infrastructure using Python, or experience navigating/contributing to large TypeScript codebases.
Hands-on experience with preference data collection and/or rubric creation.
Strong written and verbal communication skills.
Ability to distill complex technical work into clear, structured, actionable summaries.
Demonstrated high-taste judgment and ability to explain why something is high quality.
Ability to work independently in ambiguous, fast-paced environments.
Ability to work at least 4 hours overlapping with PST.
Active LinkedIn profile required.
Experience with large TypeScript codebases such as VSCode or similar.
Experience working on AI/LLM-related projects.
Experience with data generation, evaluation, labeling, or quality workflows.
Experience collaborating closely with researchers and engineers.
Note: Candidates currently working with Microsoft are not eligible for this opportunity.
Please submit an updated resume with an active LinkedIn profile.
| Location | NULL, AK (Remote) |
Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.
Free resume templatesImprove your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.
Free resume builder