Technical Lead and Senior Software Engineer – Big Data, Hadoop, AWS Elastic MapReduce

US-CA-Palo Alto
9 months ago
Job ID
312752
Amazon Corporate LLC
Recruiting Team
North American Teams - AWS

Job Description

Amazon Web Services' (AWS) has started a brand new team (Glue) with a focus on building the ETL solution on the cloud. Glue's mission is to enable our web services infrastructure to support scientific and business analysis on large data sets with extreme ease of use.

AWS Glue is a fully managed ETL service that makes it easy to move data between your data stores. AWS Glue simplifies and automates the difficult and time consuming data discovery, conversion, mapping, and job scheduling tasks. AWS Glue guides you through the process of moving your data with an easy to use console that helps you understand your data sources, prepare the data for analytics, and load it reliably from data sources to destinations.

The team makes it easy and secure to use the massive scale of parallel computing by non specialized software programs, via multiple layers of abstractions, as well as development and deployment tools. The team aspires to work with the open source community and to contribute significant portion of its software to the open source. This will involve bug fixes, new functionality and individual time contributions in open source projects possibly including Hadoop, Pig, Hbase and others.

We are looking for an experienced technical expert in web services technologies to help us build our team in Palo Alto. As a senior engineer, you will work independently and with other software engineers including Principal engineers as well as program/product managers to create distributed services and front-end APIs for developers to consume. You will help shape the overall structure of the Amazon's web service offerings.

Key Responsibilities:
  • Responsible for the over-all systems architecture, scalability, reliability, and performance.
  • Responsible for real-time operational support of the team's functional areas.
  • Developing and delivering quality services on-time and on-budget. Solutions developed by the team use Java, XML, HTTP, SOAP, Hadoop, Pig and other web technologies.
  • Maintaining current technical knowledge to support rapidly changing technology, always on a look out for new technologies and work with management and development team in bringing new technologies.
  • Candidate must be able to work with a minimum of technical supervision and supplemental engineering support, while responding efficiently to multiple program priorities.

Basic Qualifications

  • Bachelors degree in computer science or equivalent experience.
  • 6+ year's overall development experience and 3+ year's enterprise software experience.

Preferred Qualifications


  • Masters degree in computer science
  • Core competencies in Java, XML, HTTP, SOAP plus Hadoop (or other Map Reduce implementations)
  • Strong knowledge of data structures, algorithms, enterprise systems, and asynchronous architectures.
  • Deep understanding of web services software architectural and design issues.
  • Experience with HBase and other cloud computing technologies (strong plus).
  • Experience with HPC technologies (strong plus).
  • Experience with other web technologies such as WS* and .Net (plus).
  • Excellent verbal and written communication skills.
  • Proven track record on delivering results, especially in the area of writing high-performance, reliable and maintainable code.
  • Ability to adapt to new development environments, changing business requirements and learning new systems highly desired.
  • Experience with large distributed services is a plus as is building/operating highly available systems
  • Experience of leading the architecture of an open source messaging product is preferred
  • Ability to work well in a team environment and be able to effectively drive cross-team solutions that have complex dependencies and requirements.
  • Strong technical vision, presentation and technology leadership skills
  • Ability to handle multiple competing priorities in a fast-paced environment


*LI-AS2

aws-sdesdm-na
Sorry the Share function is not working properly at this moment. Please refresh the page and try again later.
Share on your newsfeed