| Title | Data Engineer |
| Posting Date: | 05/27/2019 |
| Location: | Multiple Locations |
| Job Type | Full Time |
Position:
We are looking for a Data Engineer who can help create a new model of data architecture to support business units with better access to data, drive the design and use of a new data warehouse and build automated ETL/ELT processes to connect data across the organization. We’re building a data practice from the ground up, you’ll get to shape this work and help drive our data-informed culture.
Essential Functions& Summary of Responsibilities:
Implement and oversee the Data Warehousing (possibly Snowflake) and ETL infrastructure
Define and establish processes to maintain the integrity of data within our data pipeline and warehouse
Ensure quality of data and completeness of event logging across enterprise codebase
Integrate data from 3rd party services such as SalesForce, New Relic, Splunk.
Develop ETL jobs and tests to process, validate, transport, collate, aggregate, and distribute data
Transform raw event logs into higher-order tables to make existing analysis easier and new analysis possible
Be part of a new team championing a data-informed culture
Build workflows that empower analysts and scientists to efficiently use data in Tableau and open source data visualization tools
Other duties and tasks as assigned
Qualifications Requirement (Knowledge, Skills, Abilities):
Expertise building data pipelines with streaming and batch ETL patterns on complex datasets using Python/Docker/SQL
Ability to architect the entire data ecosystem with flows and dependencies across numerous internal systems and new cloud applications
Software Engineering experience with expertise in at least one high-level programming language (preferably Python)
Strong SQL writing skills
Experience with orchestration tools such as Airflow (preferred) or Luigi
Exceptional communication skills and desire to share your knowledge with clarity, patience, and empathy
The ability to work independently and set your own priorities with careful attention to detail and deadlines
Familiarity with Data Visualization tools such as Tableau, Looker, Superset
Familiarity with data warehousing; Specific familiarity with Azure data warehousing infrastructure a plus