Computer Task Group, Inc logo

Data Engineer-(Microsoft Fabric, Spark/PySpark)

Computer Task Group, Inc

  • NY
  • 3 days ago
  • Remote
  • $50–$55 Per Hour
Computer Task Group, Inc
Want to know if you’re a fit?
Upload your resume and let our AI show you.

Skills

  • Agile Programming Methodologiesunmatched
  • Analysis Skillsunmatched
  • Architectural Analysisunmatched
  • Atlassian JIRAunmatched
  • Best Practicesunmatched
  • Business Solutionsunmatched
  • Cloud Computingunmatched
  • Code Reviewsunmatched
  • Communication Skillsunmatched
  • Compensation and Benefitsunmatched
  • Computer Scienceunmatched
  • Continuous Deployment/Deliveryunmatched
  • Continuous Improvementunmatched
  • Continuous Integrationunmatched
  • Data Managementunmatched
  • Data Modelingunmatched
  • Data Processingunmatched
  • Data Qualityunmatched
  • Data Scienceunmatched
  • Data Setsunmatched
  • Data Structuresunmatched
  • Data Warehousingunmatched
  • Database Designunmatched
  • Database Extract Transform and Load (ETL)unmatched
  • Engineeringunmatched
  • English Languageunmatched
  • Enterprise Architectureunmatched
  • Enterprise Data Integrationunmatched
  • Federal Laws and Regulationsunmatched
  • File Managementunmatched
  • Identify Issuesunmatched
  • Jenkinsunmatched
  • Kanbanunmatched
  • Legalunmatched
  • Metadataunmatched
  • Microsoft Product Familyunmatched
  • NCR Teradataunmatched
  • Performance Tuning/Optimizationunmatched
  • Presentation/Verbal Skillsunmatched
  • Problem Solving Skillsunmatched
  • Scalable System Developmentunmatched
  • Snowflake Schemaunmatched
  • Software Developmentunmatched
  • Software Engineeringunmatched
  • State Laws and Regulationsunmatched
  • Systems Engineeringunmatched
  • Testingunmatched
  • Writing Skillsunmatched

Description

CTG is seeking to fill a Data Engineer (Microsoft Fabric, Spark/PySpark) position for our client. Join a dynamic data engineering team responsible for designing and delivering modern lakehouse solutions that support enterprise analytics and data-driven decision-making. This role focuses on building scalable data pipelines, implementing Microsoft Fabric lakehouse architectures, and developing Spark/PySpark solutions that integrate data from multiple enterprise systems. Candidates with Databricks or comparable lakehouse platform experience are also encouraged to apply. Location: Remote Duration: 7 months Duties: Design, develop, and support enterprise data engineering solutions using Microsoft Fabric. Build and maintain scalable lakehouse architectures, including schema design and data organization. Develop Spark Notebooks and Spark/PySpark applications for data ingestion, transformation, and processing. Create and orchestrate reliable data pipelines integrating data from numerous enterprise source systems. Design and manage file structures, metadata, and storage organization within lakehouse environments. Implement and maintain security, permissions, and governance across Microsoft Fabric workspaces. Optimize data processing performance and troubleshoot production issues. Collaborate with architects, analysts, and business stakeholders to deliver high-quality data solutions. Participate in Agile development processes, code reviews, testing, and CI/CD deployment activities. Contribute to continuous improvement of data engineering standards and best practices. Skills: Required Strong experience with Microsoft Fabric, including: Lakehouse architecture and implementation Spark Notebook development Schema design and management File and folder structure management Security, permissions, and access management Hands-on Spark or PySpark development experience. Experience building and orchestrating enterprise data pipelines. Experience integrating data from multiple source systems (10+ preferred). Strong understanding of lakehouse data structures and data organization. Excellent analytical, troubleshooting, and problem-solving skills. Preferred Databricks lakehouse engineering experience or experience with other modern lakehouse platforms. Experience with cloud-based data engineering environments. Jira, Kanban, and Agile methodologies. Jenkins and CI/CD pipeline implementation. Experience with enterprise data warehouse platforms such as Snowflake or Teradata. Experience: 5+ years of experience in Data Engineering, Data Warehousing, or related disciplines. Proven experience designing and implementing scalable enterprise data platforms. Strong hands-on experience with Spark/PySpark for large-scale data processing. Experience developing modern lakehouse solutions using Microsoft Fabric, Databricks, or similar technologies. Experience integrating and managing large, complex datasets from multiple enterprise systems. Strong understanding of data modeling, ETL/ELT processes, and enterprise data architecture. Experience working within Agile software development environments. Education: Bachelor's degree in Computer Science, Information Systems, Engineering, Data Science, or a related technical field. Equivalent combination of education and relevant professional experience will also be considered. Excellent verbal and written English communication skills and the ability to interact professionally with a diverse group are required. CTG does not accept unsolicited resumes from headhunters, recruitment agencies, or fee based recruitment services for this role. To Apply: To be considered, please apply directly to this requisition using the link provided. Kindly forward this to any other interested parties. Thank you! The expected base salary for this position ranges from $50.00 to $55.00/hour. Salary offers are based on a wide range of factors including relevant skills, training, experience, education, market factors, and where applicable, licensure or certifications obtained. In addition to salary, a competitive benefit package is also offered. About CTG CTG, a Cegeka company, delivers IT and business solutions that enhance clients' digital agility, empowering them to seize new opportunities and overcome any challenge. Backed by more than 60 years' experience and a commitment to being a reliable, results-driven partner, we work shoulder to shoulder with clients to shape digital together. Our vision is to be an indispensable partner to our clients and the preferred career destination for digital and technology experts. With more than 9,000 team members in over 15 countries, we combine global expertise with local insight to deliver innovative solutions. We operate across the Americas, Europe, and India, working with over 3,000 clients in many of today's highest-growth industries. Together, we shape what's next-working shoulder to shoulder to deliver impactful solutions for our clients and society. Our culture is built by the people who work at CTG, the values we hold, and the actions we take. It's a living, breathing thing that is renewed every day through the ways we engage with each other, our clients, and our communities. At CTG, you'll find a workplace where you are encouraged to grow, supported in your ambitions, and empowered to shape your own career journey. For more information, visit www.ctg.com. CTG will consider for employment all qualified applicants including those with criminal histories in a manner consistent with the requirements of all applicable local, state, and federal laws. CTG is an Equal Opportunity Employer. CTG will assure equal opportunity and consideration to all applicants and employees in recruitment, selection, placement, training, benefits, compensation, promotion, transfer, and release of individuals without regard to race, creed, religion, color, national origin, sex, sexual orientation, gender identity and gender expression, age, disability, marital or veteran status, citizenship status, or any other discriminatory factors as required by law. CTG is fully committed to promoting employment opportunities for members of protected classes.

Numbers & Facts

LocationNY (
Remote
)
IndustryComputer/IT Services
Salary$50–$55 Per Hour
Company Size2,500 to 4,999 employees
Year Founded1966
Websitehttp://www.ctg.com/

About Company

CTG (NASDAQ: CTG) provides industry-specific IT services and solutions that address the business needs and challenges of clients in high-growth industries in North America and Western Europe. CTG also provides strategic staffing services for major technology companies and large corporations. Backed by more than 50 years of experience and proprietary methodologies, CTG has a proven track record of reliably delivering high-value, industry-specific staffing services and solutions to its clients. CTG has operations in North America, Western Europe, and India.

CTG's greatest asset is its people, and as such, we are committed to providing employees programs and processes to support their performance, hone their skills, and advance in their careers. This commitment is reflected by CTG being named a Best Places to Work in Healthcare company by Modern Healthcare (2013-2016) in North America, and a Best Workplace in the United Kingdom (2013), Belgium (since 2007), and Luxembourg (since 2011).

CTG will consider for employment all qualified applicants including those with criminal histories in a manner consistent with the requirements of all applicable local, state, and federal laws.

CTG is an Equal Opportunity/Affirmative Action Employer and strong advocate of workforce diversity. Minority/Female/Sexual Orientation/Gender Identity/Disability/Veteran.

Similar Jobs