Sign upLog in

Sr. Data Pipeline Engineer - Python

Thorndale Partners

La Vergne, TN

Apply
JOB DETAILS
SKILLS
Analysis Skills, Apache Cassandra, Apache Kafka, Computer Engineering, Computer Programming, Computer Science, Continuous Deployment/Delivery, Continuous Integration, Data Management, Data Modeling, Data Quality, DataArchitect Data Modeling Tool, Database Administration, Database Architecture, Database Design, Database Extract Transform and Load (ETL), Distributed Computing, Information Technology & Information Systems, Information/Data Security (InfoSec), Microsoft SQL Server, Microsoft Transact-SQL (T-SQL), MongoDB, Multiplatform/Cross-Platform, MySQL, NoSQL, Operations Management, Performance Management, Performance Tuning/Optimization, Prototyping, Python Programming/Scripting Language, Quality Assurance, Query Optimization, Retail Management, SQL (Structured Query Language), SQL Server Integration Services (SSIS), Scripting (Scripting Languages), Security Infrastructure, Software Development Lifecycle (SDLC), Software Engineering, Stored Procedures, Systems Administration/Management, Technical Leadership, Testing
LOCATION
La Vergne, TN
POSTED
30+ days ago
DETAILS: SR DATA PIPELINE ENGINEER PYTHON
Title: Sr. Data Pipelines Engineer Python / MySQL / NoSQL
Compensation: The total compensation for this role will be 155k-170/year to start with a Base salary 130-140k + Bonus + Work life balance, strong culture, strong paid time off package with sick/vacation/personal time and Excellent benefits
Location : Hybrid Role (4 days in office/ 1 Remote ) Office is in Smyrna, TN (Suburb of Nashville)

OVERVIEW: SR DATA PIPELINE ENGINEER PYTHON
This person will design, build, and optimize the systems to gather, ingested, store, analyze, transform, and distribute data. Design, build, and support data pipelines, from ingestion to the creation of Operational Data Stores (ODS). Act as the senior/lead technical programmer on the team. Works with the data architect, CI/CD architects, and other data engineers to build and deliver world-class data platforms.

RESPONSIBILITIES: SR DATA PIPELINE ENGINEER PYTHON
  • Pipeline Development: Design and implement robust ETL/ELT data pipelines using Apache Kafka for streaming and batch processing.
  • Database Management: Architect and maintain both Relational (MySQL, SQL Server) and Non-relational (NoSQL) database environments to ensure high performance and scalability.
  • SQL server related: Transact-SQL, ETL and Data warehousing, SQL server management studio, maintaining and optimizing stored procedures, maintaining and monitoring background jobs.
  • ODS Architecture: Build and manage Operational Data Stores to integrate data from disparate sources for real-time and batched operational reporting.
  • Data Handling: Write complex, optimized SQL queries, develop Python scripts using libraries like Pandas, NumPy, and PySpark, and integrate Kafka for sophisticated data transfer, manipulation and cleansing.
  • System Optimization: Monitor and tune database performance, ensuring data integrity and security across all platforms.
  • Lead and execute testing to ensure data validation and data integrity.
  • Drives solutions and guides the work of others to provide full application development life cycle support including specifications, prototypes, development, quality assurance, and deployment.

MINIMUM REQUIREMENTS: SR DATA PIPELINE ENGINEER PYTHON
  • Education: Bachelor's or master's degree in computer science, Computer Engineering, IT, or a closely related technical field.
  • 6+ years of professional experience in data engineering or a similar data-intensive role.
  • Core Languages: Expert-level proficiency in SQL and Python.
  • Databases: Deep experience with MySQL and at least one major NoSQL provider (e.g., MongoDB, Cassandra).
  • Integration: Hands-on experience creating and deploying SSIS Packages.
  • Streaming: Proven experience using Apache Kafka for event-driven architecture.
  • Concepts: Strong understanding of data modeling, schema design, and distributed systems
Thorndale Partners, LLC
Your trusted talent acquisition partner working to provide a premium experience to both job seekers and hiring managers.
Please visit our Website to learn more and follow us on LinkedIn .

About the Company

T

Thorndale Partners

Thorndale Partners llc was founded by merging assets from two long standing Nashville based staffing agencies with 17 years in the market and a back office funding partner with over 40 years of funding and managing the back office for multiple professional staffing businesses. We have three divisions:

Thorndale Technology : supporting all levels of IT staffing for corporations, technology companies, and startups.

Thorndale Health : Supporting all levels of technology related staffing for healthcare organizations, healthcare technology companies, and healthcare consulting firms.

Thorndale Finance : Supporting staffing for the Accounting and Financial roles for all the organizations our other divisions support as well.

Our goal is to quietly become the team retained by clients providing the best options to the highly competitive and tight candidate market. We work primarily on private search and hold the information about candidates we work with in the highest level of confidentiality.

We are and will continue to be the firm noted for the highest level of integrity and accuracy in details related to job opportunities and the backgrounds of candidates we represent.

COMPANY SIZE
50 to 99 employees
INDUSTRY
Other/Not Classified
FOUNDED
2012
WEBSITE
http://www.thorndalepartners.com/

Resume Resources

Free Resume TemplatesFree Resume Builder