Data Engineer

APN consulting Group

Austin, TX

JOB DETAILS
JOB TYPE
Contractor
SKILLS
Analysis Skills, Apache Hadoop, Apache Spark, Architectural Analysis, Artificial Intelligence (AI), Business Skills, Business Solutions, Cloud Computing, Consulting, Cross-Functional, Data Analysis, Data Management, Data Mapping, Data Modeling, Data Quality, Data Warehousing, Database Extract Transform and Load (ETL), Design Patterns Programming Methodologies, Git, Interpersonal Skills, Java, Leadership, Policy Implementation, Problem Solving Skills, Process Improvement, Python Programming/Scripting Language, Reconciliation, Relational Databases (RDBMS), SQL (Structured Query Language), Scala Programming Language, ServiceNow, Team Player, Technical Recruiting, Time Management, User Documentation, Zip
LOCATION
Austin, TX
POSTED
30+ days ago
APN Consulting, Inc. is a progressive IT staffing and services company offering innovative business solutions to improve client business outcomes. We focus on high impact technology solutions in ServiceNow, Fullstack, Cloud & Data, and AI / ML. Due to our globally expanding service offerings we are seeking top-talent to join our teams and grow with us. Role : Data Engineer Work Location with ZIP: Austin-TX-78753 Top 3 Required skills: Spark, Scala, SQL We are seeking a highly experienced Engineer to join our team and own the development of a Tiered data architecture for our data. In this role, they would be responsible for crafting and building a comprehensive data architecture that will enable seamless data integration and enable the delivery of high-quality insights to our leadership and business stakeholders. Skills Required : Apache Spark, SQL, git, Programing Language (Python, Java, Scala) Nice to have : Understanding of Design Patterns, Able to discuss tradeoffs between RDBMS vs Distributed Storage Key Qualifications - Proven experience in data engineering, data architecture, or a related field - Experience in building and deploying tiered data architecture for analytics data is a plus - Strong understanding of data modeling, data warehousing, and ETL concepts - Proficiency in SQL and experience with at least one major data analytics platform, such as Hadoop or Spark - Experience with data orchestration tools like Airflow is a nice to have - Excellent problem-solving and analytical skills, and the ability to work well under tight deadlines - Excellent interpersonal skills and the ability to collaborate effectively with cross-functional teams Description - Design and implement a tiered data architecture that integrates analytics data from multiple sources in an efficient and effective manner. - Develop data models and mapping rules to transform raw data into actionable insights and reports. - Collaborate with the analytics and business teams to understand their requirements and deliver solutions that meet their needs. - Ensure data quality and accuracy by developing data validation and reconciliation processes. - Play an active role in the development and maintenance of user documentation, including data models, mapping rules, and data dictionaries. - Collaborate with multi-functional teams to define and implement data governance policies and standards. - Stay informed about the latest developments in data analytics and data management technologies and recommend new tools and methodologies to improve the semantic layer. We are committed to fostering a diverse, inclusive, and equitable workplace where individuals from all backgrounds feel valued and empowered to contribute their unique perspectives. We strongly encourage applications from candidates of all genders, races, ethnicities, abilities, and experiences to join our team and help us build a culture of belonging.

About the Company

A

APN consulting Group