Analysis Skills, Apache, Application Programming Interface (API), Automation, Cloud Computing, Cloud Storage, Continuous Deployment/Delivery, Continuous Integration, DNS (Domain Name System), Database Design, DevOps, GCP (Good Clinical Practices), Identify Issues, Java, Jenkins, Maintain Compliance, Oracle PL-SQL, Performance Tuning/Optimization, Python Programming/Scripting Language, Resource Management, Single Sign-On (SSO)
Enhance Dataflow and/or Dataproc Data ingestion pipelines (batch & Streaming) .
- Have Good Understanding of GCP Composer (Apache Airflow) environments.
- Manage Airflow DAGs and troubleshoot Airflow-related issues.
- Monitor and optimize Composer performance and scalability.
- Maintain GCP infrastructure including services like:
- Google Cloud Storage (GCS)
- BigQuery (BQ)
- Cloud Dataflow ( Apache Beam )
- Cloud Dataproc
- Cloud Functions
- Cloud Run
- Have Good Understanding of:
- IAM and service account permissions
- Secret Manager
- Monitor GCP usage and quotas, and proactively prevent quota-related issues.
- Set up and manage alerting, logging, and monitoring using tools like Stackdriver (Cloud Monitoring & Logging).
- DB design experience (with Excellent RDBS-PLSQL knowledge )
- Design Springboot APIs
- Analyze, design, create Dockerfile
- Knowledge on Angular ( Good to Have )
- Design and implement infrastructure as code using Terraform for provisioning and managing GCP resources.
- Collaborate with DevOps and development teams to manage CI/CD pipelins using Jenkins and other automation tools.
- Ensure security, compliance, and cost-efficiency across the cloud environment.
- Document system configurations, procedures, and best practices.
- Proficient in either Java or Python programming languages.
- Knowledge on DNS and SSO configuration setup