Senior Data Engineer

TechDigital
  • Atlanta, GA
    12 days ago

    Job Description

    Skill Last UsedExperience in Years/monthHands on Exp.
    Yes/No
    Big Data
    Hadoop/ Spark
    Databricks/ Cloudera
    ETL

    Job Description:
    Senior Data Engineer who is passionate about data and analytics, highly motivated and can take technical ownership of data solutions with an emphasis on engineering efficiency and on-time delivery.
    The ideal candidate is exposed to the fast-paced world of Big Data technology and has experience in building data solutions using new and emerging technologies while maintaining stability of the platform. The person will get a chance to work with diverse datasets and be on the cutting edge of transforming the way Client captures, processes, stores and visualizes data.
    Role-
    In this role, you will:
    • Design & Develop batch and streaming solutions using various Big Data technologies
    • Work closely with architect to design secure and scalable
    • Be responsible for assessing technologies and approaches for ingestion, transformation and storage
    • Develop software utilizing open source technologies to interface with distributed and relational data sources
    • Work closely with team members from across Client to identify functional and system requirements
    All About you-
    The ideal candidate for this position should:
    • Hands-on experience with Big Data and analytics technologies including Hadoop, Spark, and related frameworks.
    • Programming expertise in languages such as Java, Scala, or Python, with an emphasis on developing data processing and transformation logic.
    • Real-time and batch data processing skills with experience in building robust data pipelines for real-time or near-real-time ingestion.
    • Proficiency in data modeling and schema design for relational and non-relational databases, supporting high data volume, and optimized query performance.
    • Exposure to cloud technologies with hands-on experience in Databricks and Cloudera, including knowledge of cloud architecture, data security, and scalability best practices.
    • Experience in optimizing and managing ETL workflows using scheduling, monitoring, and debugging tools.
    • Strong problem-solving abilities with a mindset for automation and efficiency improvements.
    • Excellent communication and collaboration skills to work effectively across technical and business teams, facilitating knowledge sharing and alignment on data engineering best practices.
    • Proven track record of delivering software projects and willingness to roll up sleeves to get the job done,
    • Have excellent oral and written communication
    • Be familiar with Agile/Scrum methodologies
    • Have the ability to manage multiple priorities simultaneously
    • Have a BS/BA degree in Computer Science, Information Systems or related field

    Numbers & Facts

    LocationAtlanta, GA
    IndustryOther/Not Classified
    Company Size100 to 499 employees

    Skills

    • Agile Programming Methodologiesunmatched
    • Apache Hadoopunmatched
    • Apache Sparkunmatched
    • Architectural Designunmatched
    • Automationunmatched
    • Best Practicesunmatched
    • Big Dataunmatched
    • Cloud Architectureunmatched
    • Cloud Computingunmatched
    • Clouderaunmatched
    • Communication Skillsunmatched
    • Computer Scienceunmatched
    • Data Analysisunmatched
    • Data Managementunmatched
    • Data Modelingunmatched
    • Data Processingunmatched
    • Data Setsunmatched
    • Data Visualizationunmatched
    • Database Designunmatched
    • Database Extract Transform and Load (ETL)unmatched
    • Debugging Toolsunmatched
    • Emerging Technologyunmatched
    • Information Technology & Information Systemsunmatched
    • Information/Data Security (InfoSec)unmatched
    • Javaunmatched
    • Multitaskingunmatched
    • Open Sourceunmatched
    • Performance Tuning/Optimizationunmatched
    • Presentation/Verbal Skillsunmatched
    • Problem Solving Skillsunmatched
    • Python Programming/Scripting Languageunmatched
    • Query Optimizationunmatched
    • Relational Databases (RDBMS)unmatched
    • Scala Programming Languageunmatched
    • Scrum Project Management and Software Developmentunmatched
    • Software Developmentunmatched
    • Team Playerunmatched
    • Technology Analysisunmatched
    • Time Managementunmatched
    • Writing Skillsunmatched

    Be found by employers

    5,500+ employers search our resume database daily. Add yours to get found by recruiters looking for candidates like you.

    Level up your application

    Professional resume templates

    Browse dozens of recruiter approved resume templates, layouts and formats. Choose your favorite and make it your own in minutes.

    Free resume templates

    Free resume builder

    Improve your existing resume or start from scratch and create a standout, ATS-friendly resume. Add job-specific content, download and apply.

    Free resume builder