| Title | Big Data Automation Engineer |
| Posting Date: | 03/04/2019 |
| Location: | Multiple Locations |
| Job Type | Full Time |
We are looking for a QA automation engineer who will be responsible for building/maintaining automation frameworks for Big Data projects, working closely with architecture, engineering and product teams to deliver quality solutions. This is not a typical GUI automation kind of role and the ideal candidate has hands on experience on building automation frameworks on big data / high volume data pipelines / ETL projects.
Responsibilities and Duties:
• Testing and developing automation for high volume data pipelines, ETL transformations, and other data integration workflows across multiple sources while applying best practices in data integrity, data quality, and distributed data processing.
• Designing and developing testing infrastructure and executing automation scripts on a scheduled basis for Big Data Platforms with understanding of Big Data programming models.
• Perform both manual testing, and implementing test automation frameworks.
• Research related products and make necessary software recommendations & implement innovative solutions
• Perform load/performance testing
• Write test plans, test cases, status reports and summary reports.
• Participate in daily scrum and bi-weekly sprint planning meetings.
Required Experience, Skills and Qualifications:
• Developing automation tools and scripting languages such as Java, JavaScript / NodeJS, or Python etc.
• Hands on programming and automation experience including REST API services.
• Advanced SQL writing and expertise in data warehousing (SQL, ETL, Data Modeling, etc.) and using data warehouses/databases such as Aurora / MySQL, RedShift etc. in a business environment with complex datasets.
• Exposure to AWS Big Data technologies (EMR / RedShift / Kinesis etc.)
• Bachelor’s Degree in Computer Science, or equivalent education and relevant experience required.