Data Lake Engineer - US Citizen & Green Card only

US Citizen & Green Card only

Position: Data Lake Engineer

Location: Ideally 2-3 days onsite

Duration: 6+ months

Authorization: Hire Eligible candidates only

Position Summary:

This position is responsible for being part of a growing team to support data lake repository and related ETL processes using Fivetran, Databricks and other technologies.  In addition to creation of data lake systems this job is also responsible for data ETL, data curation and data quality check processes.  This position supports the Data Engineering team and works in an Agile environment.

Duties:

• The ideal candidate will have a solid background in database and data lake development using technologies such as Fivetran, Databricks, Spark, AWS data lake, and traditional technologies like ETL & MS SQL Server.  The position will be part of a team building an end to end data lake and data pipelines on AWS using Agile project management methodologies
• Design and Implement end to end Data Lake solutions using the technologies listed above as well as:
• • Data integrity process using Databricks and related tools/processes
  • Integrating Data Lake with 3rd party application APIs for downstream queries
  • Access design and integrations for Data Lake users and applications
• Experience with AWS and related data technologies and concepts in the following areas is required:
• • Python
  • Athena
  • Glue/Crawlers
  • Lake Formation
  • ETL
  • Spark (PySpark a plus)
  • Workflows & automation
  • Triggers
  • Lambda Functions
  • IAM data lake security concepts/permissions
• Data Onboarding – define onboarding procedures and work with business stakeholders to onboard new data sources

Requirements:

• 5+ years of database and data management experience.
• Fivetran, Databricks, AWS or other related data certifications are highly preferred.
• Understanding of cloud technologies such as IaaS and SaaS.
• Experience working in an Agile environment.
• 4 year college degree in information technology or equivalent experience.

Beacon Staffing Alternatives, Inc. is a women-owned, strategic staffing organization that specializes in administrative staffing, IT staffing and logistics support. Headquartered in Central Maryland, Beacon Staffing utilizes state-of-the-art portals enabling employees and job seekers 24-7 online access to resources.

Beacon Staffing promises quality, integrity and reliability. Our personal knowledge and experience in the local community, combined with a contemporary approach to staffing management, makes Beacon Staffing a trusted guide with proven results.

We have maintained professional relationships with some clients for more than two decades. And, we welcome new employers regularly. We are proud to be the area’s most reputable, well-connected and accomplished temporary staffing company.