Senior Data Engineer — InMarket (via Remotesome)

About InMarket

Since 2010 InMarket has been a leader in 360-degree consumer intelligence and real-time marketing for thousands of major brands. Through InMarket’s data-driven marketing platform, brands can build targeted audiences, activate real-time, and measure success in driving sales. 

InMarket, which raised no venture capital funding to date, holds more than 27 patents across location, attribution and digital marketing, and its GeoLink self-service marketing platform was awarded Best Location Marketing Platform at the 2021 MarTech Breakthrough Awards and best Location Platform at the 2020 Digiday Technology Awards. InMarket ranked 280 on the 2021 Deloitte Technology Fast 500 list and its nationwide team is united across more than 20 states.

About this role

We are looking for a talented Senior Data Engineer to join the team that builds the essential data infrastructure at the heart of InMarket’s product suite. You should be a quick learner who is enthusiastic about learning new technologies. You should be a passionate engineer who will empower fellow engineers to write clean and efficient data pipelines. You will implement technical solutions to empower internal/external customers and scale the existing data platform. You will work closely with end users to develop and define key business questions, lead fellow engineers to define technical solutions, then work with Product Managers to build the data sets that answer those questions. You will work with huge datasets and build ETL’s that bring data together to answer business questions, conduct reporting, and drive growth.

Responsibilities

• Design and implement ETL pipelines in Apache Airflow, Big Query, Python, and Spark to transform various upstream sources data into curated data assets for use across InMarket’s vast array of data driven products 

• Stay up to date with and advocate internally for Data Engineering best practices, technologies, and testing frameworks that will help shape InMarket’s technical future 

• Architect and plan projects involving highly distributed and high performance data platform systems

• Provide technical guidance to other engineers in order to help promote the growth of their knowledge and technical capabilities

• Communicate complex concepts and the results of the analyses in a clear and effective manner to Product and Engineering Managers

• Identify areas for improvement in existing pipelines and processes 

• Understand business requirements and convert them to technical solutions

Qualifications Required

• Strong SQL experience 

• Expert in at least one data pipelining orchestration framework (Airflow, Luigi, etc.)

• Experience building ETL pipelines 

• Strong software engineering skills in an Object Oriented language such as Java or Python 

• Experience building and optimizing a data warehouse on a major cloud platform (Big Query preferred but not required) 

• Experience and deep understanding of Big Data Technologies such as Hadoop and Spark 

• Experience with building and optimizing large scale and high-performance systems 

• Extensive knowledge of data related tools and architecture concepts in a major cloud platform 

• Knowledge of Kubernetes, Docker, Airflow, Git, and CD/CI best practices 

• Strong collaboration and communication skills within and across teams 

• B.S. or M.S. in Computer Science or a related technical field 

• At least 4 years of software engineering experience, ideally in data engineering

Qualifications Preferred

• Experience in Python, SQL, and Spark 

• Experience in Apache Airflow 

• Experience in optimizing Big Query performance 

• Experience building a data governance platform in a regulated environment 

• Experience with various data testing frameworks and technologies 

• Familiarity with the digital media / advertising industry

Required Skills

• Python — Advanced
• Java — Advanced
• Airflow or similar orchestration framework — Advanced
• Spark — Advanced
• Big Query — Advanced
• GCP (Azure or AWS also works) — Advanced
• Hadoop — Advanced
• Kubernetes — Advanced
• Docker — Advanced
• Git — Advanced
• CI/CD — Advanced

Compensation

$90K – $110K/year

Timezone: UTC-8 to UTC-3