Best Buy logo

Senior Data Engineer - Ad Serving

Best Buy
  • Saint Paul, Minnesota
    30+ days ago

    Job Description

    Join Best Buy's Ad Serving team to help design, build, and operate a next-generation, machine learning-powered Ad Serving platform. In this role, you'll be at the core of integrating large-scale data pipelines, real-time model serving, and advanced analytics to deliver optimal, high-performance ad experiences.

    As a member of the Ad Decisioning team, you will work with other engineering teams across the Best Buy marketing ecosystem to create an integrated, reliable, and scalable system spanning GCP and AWS. Your work will ensure that data flows seamlessly-from ingestion, transformation, and model training to real-time ad delivery decisions.

    This role is remote eligible, which means you would work virtually from home or another non-Best Buy location.

    What You'll Do
    • Implement scalable ETL/ELT pipelines to process large volumes of clickstream, behavioral, and ad performance data in real time and batch modes.
    • Build and maintain integrations between the Ad Server, ML models, and supporting systems such as UIs, analytics platforms, and reporting databases.
    • Work closely with data scientists to operationalize ML models for real-time ad decisioning and bidding.
    • Leverage GCP Big Query, Dataflow, Airflow, Pub/Sub, AI Platform and AWS Glue, Kinesis, Lambda, SageMaker, Athena for data ingestion, transformation, and model deployment.
    • Architect cloud-native data workflows ensuring high availability, low latency, and fault tolerance.
    • Work with the operations team to develop CI/CD pipelines for data pipelines and ML model deployments, enabling fully automated testing and releases.
    • Participate in on-call rotation and provide operational support for data pipelines and ML-driven ad serving.
    • Anticipate and solve data architecture and integration challenges before they impact production.

    Basic Qualifications
    • Bachelor's in Computer Science, Data Engineering; or equivalent combination of relevant professional experience and education
    • 3 years of modern development with SQL and distributed data processing frameworks such as Spark
    • 3 years of experience diagnosing and resolving complex, production-grade data and/or model serving issues
    • 3 years of hands-on cloud experience in GCP or AWS
    • 3 years of experience in designing and managing distributed data systems and pipelines
    • 2 years of Python experience
    • Demonstrated experience collaborating with data scientists, product managers, and operations engineers
    Preferred Qualifications
    • Experience with high-throughput, real-time Ad Serving systems processing thousands of requests per second
    • Strong understanding of ad delivery, targeting, and performance optimization concepts
    • Proficiency in data orchestration tools (Apache Airflow, Cloud Composer, Step Functions)
    • Deep familiarity with streaming data frameworks (Apache Beam, Kafka, Flink, Spark Structured Streaming)
    • Experience with cloud-native data stores (Big Query, DynamoDB, Aurora, RDS) and caching systems (Redis, Memcached)
    • Knowledge of distributed systems principles-state management, concurrency, messaging, and inter-service data consistency.
    What's in it for you

    We're committed to helping our people thrive at work and at home. Best Buy offers a range of benefits to support your overall well-being and provide support as you need it, especially at key moments in your life.

    Our benefits include:
    • Competitive pay
    • Great employee discount
    • Financial savings and retirement resources
    • Support for your physical and mental well-being
    Best Buy provides different types of leaves of absence (LOA) and potential pay sources to employees based on eligibility. The length of your LOA depends on your situation, where you live, your full-time or part-time employment status, and federal and state regulations. Intermittent or reduced-schedule leave is also available for certain medical or family care leaves. Paid time off (va

    Numbers & Facts

    LocationSaint Paul, Minnesota
    IndustryRetail
    Company Size10,000 employees or more
    Year Founded1966
    Websitehttp://www.bestbuy-jobs.com/

    About Company

    Energetic teams. Fun atmosphere. Exciting opportunities.

    That’s what you’ll find at Best Buy. Care to join us?

    You can feel the energy here. And we’re not talking about the hum of electronics (there’s that, too). We’re talking about people.

    Best Buy employees are friendly, enthusiastic and willing to help you succeed. Sure, we’re a big company — the world’s largest consumer electronics retailer — but that doesn’t stop us from having fun while doing what we love: bringing technology into people’s lives in meaningful ways.

    When you join our team, we consider you part of our Best Buy family. And what you do here every day will support our goal to make people’s lives better, easier and more enjoyable through the great products we sell.

    So if you’d like using your talents to help improve people’s lives, bring it! We’d love to have your energy here.

    Skills

    • AWS Lambdaunmatched
    • Ad Servingunmatched
    • Amazon Web Services (AWS)unmatched
    • Apacheunmatched
    • Apache Kafkaunmatched
    • Apache Sparkunmatched
    • Artificial Intelligence (AI)unmatched
    • Biddingunmatched
    • Cachingunmatched
    • Clickstreamunmatched
    • Cloud Architectureunmatched
    • Cloud Computingunmatched
    • Computer Scienceunmatched
    • Concurrencyunmatched
    • Continuous Deployment/Deliveryunmatched
    • Continuous Integrationunmatched
    • Data Managementunmatched
    • Data Modelingunmatched
    • Data Processingunmatched
    • Data Scienceunmatched
    • Database Extract Transform and Load (ETL)unmatched
    • Distributed Computingunmatched
    • Ecosystemsunmatched
    • GCP (Good Clinical Practices)unmatched
    • High Availabilityunmatched
    • High Throughputunmatched
    • Identify Issuesunmatched
    • Machine Learningunmatched
    • Marketingunmatched
    • On Callunmatched
    • Operational Supportunmatched
    • Performance Tuning/Optimizationunmatched
    • Python Programming/Scripting Languageunmatched
    • Redisunmatched
    • SQL (Structured Query Language)unmatched
    • Systems Administration/Managementunmatched
    • Systems Scalabilityunmatched
    • Team Playerunmatched
    • Test Automationunmatched
    • User Interface/Experience (UI/UX)unmatched
    • Work From Homeunmatched
    • memcachedunmatched

    Be found by employers

    5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.

    Level up your application

    Professional resume templates

    Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.

    Free resume templates

    Free resume builder

    Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.

    Free resume builder