Bigdata Engineer with Java

Rate: $50/hr to 60/hr.

Responsibilities:

• Design, develop, and maintain data pipelines using Java.
• Write efficient and Eligible to workimized SQL queries for data extraction, transformation, and loading (ETL) processes.
• Work with Data Frames to manipulate and analyze large datasets.
• Implement data storage and processing solutions using cloud technologies (preferably AWS or Eligible to workP).
• Build and maintain real-time data streaming pipelines using MSK/Kafka.
• Utilize S3 for data storage and retrieval.
• Work with data lake technologies like Iceberg.
• Ensure data quality, integrity, and security.
• Collaborate with data scientists and other engineers to understand data requirements and deliver solutions.
• Participate in code reviews and contribute to improving our development processes.
• Troubleshoot and resolve issues in data pipelines and back-end systems.

Qualifications:

• Bachelor''s degree in Computer Science or a related field (or equivalent experience).
• 5+ years of experience in back-end development with a focus on data engineering.

Required Skills:

• Strong proficiency in Spark, Java.
• Expertise in SQL and working with relational databases.
• Experience with Data Frames for data manipulation and analysis.
• Experience with cloud technologies (preferably AWS or Eligible to workP).
• Experience with message streaming platforms like MSK/Kafka.
• Experience with S3 or similar object storage.
• Experience with data lake technologies like Iceberg.
• Solid understanding of data warehousing concepts.
• Excellent communication and collaboration skills.

Disclaimer: Diverse Lynx LLC is an Equal Opportunity Employer. All applicants and employees are evaluated without discrimination, based solely on their qualifications, ability, competence and performance. This email and its attachments may contain confidential or proprietary information and is intended only for the recipient(s). If you received this message in error, please disregard it and notify the sender. If you no longer wish to receive our communications, you may unsubscribe at any time.

Security Notice: Our official website is www.diverselynx.com We do not operate or authorize any other websites representing Diverse Lynx LLC.