Amazon Web Services (AWS), Apache Spark, Best Practices, Big Data, Cloud Computing, Cost Control, Data Analysis, Data Management, Data Modeling, Data Processing, Data Science, Data Warehousing, DataArchitect Data Modeling Tool, Database Extract Transform and Load (ETL), Documentation, Ecosystems, GCP (Good Clinical Practices), Identify Issues, Information/Data Security (InfoSec), Leadership, Microsoft Windows Azure, Performance Management, Problem Solving Skills, Programming Languages, Python Programming/Scripting Language, SQL (Structured Query Language), Scala Programming Language, Software Engineering
Location: Tampa, FL or REMOTE
Duration: 6 + months
Azure Databricks Architect
We are seeking a skilled Databricks Architect to lead the design, implementation, and optimization of our data analytics platform using Databricks. The ideal candidate will have deep expertise in data engineering, cloud infrastructure, and big data technologies, with a strong focus on delivering scalable, secure, and high-performance data solutions.
Key Responsibilities:
Design and implement scalable and efficient data pipelines and infrastructure on Databricks.
Architect end-to-end data solutions integrating Databricks with cloud platforms (AWS, Azure, GCP).
Collaborate with data scientists, data engineers, and business stakeholders to understand data requirements and translate them into technical solutions.
Optimize and tune Databricks clusters to improve performance and reduce costs.
Ensure data security, governance, and compliance within the Databricks environment.
Develop best practices, standards, and documentation for Databricks architecture and usage.
Troubleshoot and resolve technical issues related to Databricks platform and integrations.
Qualifications:
Proven experience architecting large-scale data solutions using Databricks.
Strong knowledge of Apache Spark and its ecosystem.
Proficiency in programming languages such as Python, Scala, or SQL.
Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
Familiarity with data warehousing, ETL processes, and data modeling.
Strong understanding of data security, compliance, and governance practices.
Role Descriptions: We are seeking a skilled Databricks Architect to lead the design| implementation| and optimization of our data analytics platform using Databricks. The ideal candidate will have deep expertise in data engineering| cloud infrastructure| and big data technologies| with a strong focus on delivering scalable| secure| and high-performance data solutions.Key ResponsibilitiesDesign and implement scalable and efficient data pipelines and infrastructure on Databricks.Architect end-to-end data solutions integrating Databricks with cloud platforms (AWS| Azure| GCP).Collaborate with data scientists| data engineers| and business stakeholders to understand data requirements and translate them into technical solutions.Optimize and tune Databricks clusters to improve performance and reduce costs.Ensure data security| governance| and compliance within the Databricks environment.Develop best practices| standards| and documentation for Databricks architecture and usage.Troubleshoot and resolve technical issues related to Databricks platform and integrations.QualificationsProven experience architecting large-scale data solutions using Databricks.Strong knowledge of Apache Spark and its ecosystem.Proficiency in programming languages such as Python| Scala| or SQL.Experience with cloud platforms such as AWS| Azure| or Google Cloud Platform.Familiarity with data warehousing| ETL processes| and data modeling.Strong understanding of data security| compliance| and governance practices.
Essential Skills: We are seeking a skilled Databricks Architect to lead the design| implementation| and optimization of our data analytics platform using Databricks. The ideal candidate will have deep expertise in data engineering| cloud infrastructure| and big data technologies| with a strong focus on delivering scalable| secure| and high-performance data solutions.Key ResponsibilitiesDesign and implement scalable and efficient data pipelines and infrastructure on Databricks.Architect end-to-end data solutions integrating Databricks with cloud platforms (AWS| Azure| GCP).Collaborate with data scientists| data engineers| and business stakeholders to understand data requirements and translate them into technical solutions.Optimize and tune Databricks clusters to improve performance and reduce costs.Ensure data security| governance| and compliance within the Databricks environment.Develop best practices| standards| and documentation for Databricks architecture and usage.Troubleshoot and resolve technical issues related to Databricks platform and integrations.QualificationsProven experience architecting large-scale data solutions using Databricks.Strong knowledge of Apache Spark and its ecosystem.Proficiency in programming languages such as Python| Scala| or SQL.Experience with cloud platforms such as AWS| Azure| or Google Cloud Platform.Familiarity with data warehousing| ETL processes| and data modeling.Strong understanding of data security| compliance| and governance practices.
Desirable Skills:
Keyword:
Q
Q1 Technologies, Inc
Q1 consists of experienced and recognized experts providing the capability to respond to market demand in order to provide professional services for our clients including Enterprise software implementations, application integration and technical / functional support.
Q1 has steadily grown into a Quality IT services and solutions organization with the average experience of our team being over 10 years. We have continuously met or exceeded client expectations by delivering professional services and project implementations on time and under budget to help clients truly recognize return on investment.