Lead Software Engineer

Big Data is undergoing exponential growth, and is dramatically disrupting enterprise IT stacks. Hadoop is leading this charge and changing the way computations are done. Big data is rapidly approaching Zetabytes of data per year, and enterprises increasing need process data faster and in scalable fashion. DataTorrent RTS platform is at the intersection of both these trends. We are focused on developing the next generation big data infrastructure for Hadoop. We enable enterprises to leverage Hadoop to ingest massive data; ETL, Analytics, taken Actions, and seamlessly connect to external systems. Our native Hadoop platform enables enterprises to take immediate action based on big data analytics.

We provide a very innovative environment for creative product development. Here you can make an impact with your ideas, initiatives, and desire to disrupt existing eco-systems. We are backed by world-renowned internet industry titans who are well connected with big companies, VC firms, and folks in Hadoop eco-system. We are based in Santa Clara, CA. Compensation includes significant equity. We are looking for smart technical leaders, with a passion for building massively scalable network-oriented software using Hadoop. An ideal candidate would have Java experience, and help build innovative Hadoop products and technologies.

The Job:

• Lead the development of applications, products and platform in Hadoop
• 
  
• Provide technical leadership and help define the direction of the company
• 
  
• Develop platform components that allow operation similar to basic database operations
• 
  
• Develop technology to handle fault tolerance, linear scale, security, and SLA enforcements
• 
  
• Develop product features and use cases that include archival, ingestion, etl, analytics, actions and interfaces to external solutions
• 
  
• Develop operators, and applications in open sourced Malhar project
• 
  
• Work closely within Hadoop eco-system to enable DataTorrent RTS to work closely with Hadoop components
• 
  
• Work with product management and business teams to analyze requirements and give technical assessment and estimates
• 
  
• Work with customers to help resolve production issues. Engage customers with their pilot projects
• 
  

Your background:

• Passionate about building world leading technologies that disrupt huge eco-systems
• 
  
• Desire to build foundational technologies that define a new eco-system
• 
  
• BS in Computer Science or equivalent degree is a must
• 
  
• At least 8 years of relevant industry experience
• 
  
• Expert coding skills in Java or C++
• 
  
• Should have experience with architecting and developing distributed and highly scalable fault tolerant systems
• 
  
• Strong knowledge of data structures and algorithms
• 
  
• Good working knowledge on networking technologies like tcp-ip, udp, http, smtp, is a strong plus
• 
  
• Experience with some of Linux, MySQL, Oracle, Berkeley DB, Hadoop MapReduce/Pig/Hive, HBase, HDFS, SVN/CVS source control systems is strong plus
• 
  
• Strong experience is one of Perl, Python, Unix Shell is a plus
• 
  
• Experience with databases like MySql, Oracle, Apache Derby is a plus
• 
  
• Strong written and verbal communication skills
• 
  

We provide

• High equity with industry standard compensation
• 
  
• Free health and vision insurance
• 
  
• Flexible vacation policy
• 
  
• An opportunity to learn new technology and work in a lean, high growth, exciting start up
•