Lead Data Engineer

We are HatchWorks Technologies

We are innovators, technologists, and builders - all dedicated to creating intelligent, purpose-built software products and solutions that improve the way people work and live. Our solutions drive revenue, market share, operational efficiencies, and, most importantly, delightful user experiences for industry leaders in healthcare, financial services, and communications, to name a few.

Our key differentiator is our product-centric approach, putting the end-user first. You will work with user-obsessed experts who always start with “why” before “what” and aspire to build feasible solutions that are viable for our customers' business and valuable for the end user. We focus on outcomes over output and believe in accelerating time to value for our customers in an agile, focused, collaborative manner. The fabric behind all of this is our people, culture, and core values, holding us all accountable to each other.

About the Role

HatchWorks is searching for an experienced data-driven Lead Data Engineer with deep knowledge in developing enterprise data solutions to solve mission-critical business needs for our clients. A Lead Data Engineer within HatchWorks will deliver successful projects by providing skilled technical expertise, leveraging strong interpersonal communication skills, and fostering deep collaboration in an Agile software development environment. This role requires a comprehensive background encompassing roles such as Data Engineer, Data Architect, Data Analyst, or Machine Learning Engineer, with a proven track record of leading and mentoring a team of data-related engineers. The ideal candidate excels in engaging with product owners and stakeholders to accurately capture and define user stories, ensuring project requirements are met effectively and in accordance with engineering best practices.

Responsibilities:

• Create and enhance data solutions enabling seamless delivery of data, responsible for collecting, parsing, managing, and analyzing large sets of data across different domains.
• Design and develop data pipelines, data ingestion, and ETL processes that are scalable, repeatable, and secure to meet stakeholder needs.
• Build data architecture to support data management strategies, supporting business intelligence initiatives and actionable insights.
• Develop real-time and batch ETL data processes aligned with business needs, manage and augment data pipelines from raw OLTP databases to data solution structures.
• Support the Agile Scrum team with planning, scoping, and creation of technical solutions for new product capabilities, ensuring continuous delivery to production.

Qualifications:

• Experience: 10+ years in roles such as Data Engineer, Data Architect, Data Analyst, or Machine Learning Engineer.
• Proven track record of leading and mentoring a team of Data related engineers.
• Experience spearheading agile solution delivery to clients.
• Strong engagement capabilities with product owners and stakeholders for defining user stories and project requirements.
• Familiarity with Snowflake, Python, PostgreSQL, MySQL, Oracle, and AWS Athena.
• Knowledge of AWS services such as S3, Lambdas, Fargate, Step Functions, SQS, SNS, and CloudWatch.
• Experience with Git using Gitlab devops platform.
• Proficiency with CI/CD pipelines using Jenkins.
• Data modeling skills, both dimensional and relational.
• Agile software delivery methodologies understanding.

Technical Skills:

• 5+ years of experience using Snowflake.
• 2+ years of Python experience and handling of CSV, JSON, and Parquet files using boto3 and pandas.
• Expertise in building data ingestion pipelines.
• Knowledge of relational database skills, including the creation of queries and stored procedures.
• Ability to read, write, understand, and speak English at a B2 level or higher.