Hybrid - Jersey City, NJ Senior Level · 8+ Years Experience
W2 Candidates Only - No C2C, No 3rd-Party Agencies Please
Summary
Builds a comprehensive QA framework in Azure Databricks that will gather, store, detect, and process large volumes of data for QA analysis and detection of bugs found in ETL code.
Role Overview
The Security Data Operations team is seeking a QA Data Engineer to design and develop a QA framework and pipeline for the Data Lakehouse. This role is a necessary component of the overall SDLC effort to centralize Information Security data and test the accuracy of storing and transforming the ETL process through the medallion architecture.
Responsibilities
Required Skills
Python SQL Azure Databricks Azure Data Factory AWS Glue ETL / ELT Data Lakehouse Medallion Architecture JIRA Agile / SDLC QA Frameworks Cloud Data Tools
#LI-EW1
For over two decades, Sharp Decisions has provided superior, award-winning service in strategic business and technology consulting services to government agencies at all levels, as well as domestic and global corporations. With subject matter expertise in Investment Banking, Finance, Healthcare, Media & Telecommunications, and Manufacturing, Sharp Decisions is well equipped to serve your needs.
Established in 1990 with headquarters in New York City, and locations in Princeton, Charlotte, Los Angeles, Phoenix, Europe and Canada, Sharp Decisions has been the technology backbone for a client portfolio that includes an array of well-known companies. As a Certified Woman-Owned Business Enterprise and approved vendor, Sharp Decisions offers a powerful, cost-effective advantage. We actively partner with other MBEs to add value and meet diversity program requirements.
Sharp Decisions is also committed to hiring and training post-9/11, tech-savvy U.S. armed forces veterans through our V.E.T.S.â„¢ (Vocation, Education and Training for Service members) Program, but we cannot do it alone. Companies like EmblemHealth, Freddie Mac and Experian have stepped up to bring aboard our highly qualified and skilled veterans. We need more companies like them to take a stand and bring our veterans aboard. Our clients have told us that our veterans are more effective than their college hires because two weeks on the job for them equates to 2-3 years of experience! Learn more at www.sharpdecisions.com/vetsprogram.