Data Engineer, Data Acquisition (Web Crawling & Pipelines)

Vagaro

Pleasanton, CA

JOB DETAILS
SALARY
$120,000–$135,000
SKILLS
Amazon Web Services (AWS), Application Programming Interface (API), Artificial Intelligence (AI), Business Support, Cloud Computing, Communication Skills, Computer Programming, Cross-Functional, Customer Relationship Management (CRM) Systems, DOM (Document Object Model), Data Cleaning, Data Collection, Data Management, Data Processing, Data Quality, Data Sets, Database Design, Database Extract Transform and Load (ETL), Dental Insurance, Detail Oriented, Distributed Computing, GCP (Good Clinical Practices), HTTP (HyperText Transport Protocol), Healthcare, Insurance, JavaScript, Large-Scale Systems, LinkedIn, Marketing, Microsoft Windows Azure, Pagination, Performance Tuning/Optimization, Presentation/Verbal Skills, Problem Solving Skills, Python Programming/Scripting Language, Quality Management, Reimbursement, SQL (Structured Query Language), Sales, Sales Support, Salesforce.com, Scalable System Development, Selenium, Structured Data, Team Player, Unstructured Data, Usability Engineering, Use Cases, Vision Plan, Writing Skills
LOCATION
Pleasanton, CA
POSTED
17 days ago

Why Vagaro? At Vagaro, we believe in fostering a collaborative and inclusive work environment where every team member can thrive. Our culture is built on innovation, continuous learning, and a passion for making a positive impact. We support our employees' growth and vision for themselves, offering opportunities for professional development and career advancement. Join us and be part of a team that values creativity, teamwork, and a commitment to excellence. Plus, we know how to have fun while getting the job done!

About the Role 

We are seeking a Data Acquisition Engineer to design, build, and scale systems that collect, process, and maintain high-quality external data from the web and third-party sources. 

This role combines hands-on web crawling, scraping, and data engineering with strong data quality and business alignment for sales, marketing, and product teams. 

*This role is based onsite in Pleasanton, CA Monday through Friday*

SPONSORSHIP NOT AVAILABLE FOR THIS POSITION

Compensation

  • Base Annual Salary: $120,000 - $135,000
  • Annual Bonus: Up to 10%

Key Responsibilities 

  • Design and build scalable web crawlers and scraping systems to extract structured and unstructured data 
  • Collect data from websites, APIs, and databases to support sales and marketing initiatives 
  • Handle dynamic content, pagination, and JavaScript-heavy sites 
  • Perform data cleaning, preprocessing, and validation to ensure accuracy and usability 
  • Deliver clean, structured datasets aligned to business requirements 
  • Collaborate with sales, marketing, and product teams to align data efforts with business goals 
  • Optimize pipelines for performance, scalability, and reliability 
  • Ensure ethical, compliant data collection practices 

Data Engineering & Infrastructure 

  • Build ETL/ELT pipelines for ingestion, transformation, and storage 
  • Implement schema design, deduplication, and change detection 
  • Manage orchestration tools (Airflow, Prefect, etc.) 
  • Work with cloud platforms (AWS, GCP, Azure) and databases 

Core Requirements 

  • 3+ years of experience in web crawling, scraping, or data engineering 
  • Strong programming skills in Python or JavaScript 
  • Experience with tools like Scrapy, BeautifulSoup, Selenium, or Playwright 
  • Understanding of HTTP, DOM parsing, and web architectures 
  • Strong data cleaning and preprocessing skills 
  • Proficiency in SQL and working with databases 
  • Strong problem-solving skills and attention to detail 
  • Excellent written and verbal communication skills 

Preferred Qualifications 

  • Experience with distributed systems or large-scale data processing 
  • Familiarity with CRM systems like HubSpot or Salesforce 
  • Knowledge of sales and marketing data use cases 
  • Experience with proxy management and crawler scaling 
  • Exposure to AI/ML tools in data workflows 

What Success Looks Like 

  • High-quality, reliable data pipelines supporting business decisions 
  • Accurate and clean datasets delivered to stakeholders 
  • Strong cross-functional collaboration with sales, marketing, and product teams 
  • Scalable and efficient data acquisition systems 

Why Join 

  • Collaborative, inclusive, and innovative work culture 
  • Opportunities for learning, growth, and career advancement 
  • High-impact role with direct business influence 

Why You'll Love Working Here: 

  • Attractive Compensation & Performance Bonuses: Enjoy a competitive salary paired with performance-based bonuses
  • Generous PTO: 15 accrued days, plus 10 company holidays annually.
  • Health & Wellness: Comprehensive healthcare, dental, and vision plans for you and your family.
  • Exclusive Perks: Discounts on attractions, theme parks, shows, sports events, movies, hotels, and more through TicketsAtWork.
  • Beauty Perks: $30/month reimbursement for any Vagaro service, including health, beauty, or wellness treatments.
  • Food Perks: $50 monthly stipend for our onsite microkitchen and a complimentary DoorDash DashPass subscription.
  • Growth Opportunities: College Assistance Reimbursement, access to EAP & Work/Life Programs, and a LinkedIn Learning account.
  • Financial Security: 401k program with 4% matching and optional life/supplemental insurance.
  • Stay Active: Access to our on-site gym, flavored water dispenser, and basketball court to keep you fit and energized!

Equal Opportunity Employer:
Vagaro is proud to be an Equal Employment Opportunity and affirmative action employer. We foster an inclusive environment where individuals are evaluated without discrimination based on gender, race, ethnicity, age, disability, religion, sexual orientation, gender identity, veteran status, or any other characteristics protected by law.

Privacy Policy:
Your privacy matters! At Vagaro, we are committed to protecting your personal information. Before proceeding with your application, please review our Employee and Applicant Privacy Notice here. By submitting your application, you acknowledge that you have read and understood our Privacy Notice, which outlines how we collect, use, disclose, and protect your information during the recruitment and employment process.

Vagaro is an E-Verify employer. Learn more at www.e-verify.gov

Learn More About Vagaro:
Visit us at vagaro.com/pro and vagaro.com to learn more.]

About the Company

V

Vagaro