Principal Data Engineer

Remote - Ontariofull timeRemote

Apply on Employer Site

senior

$138k–$172k

H1B: no

Constantcontact Principal Data Engineer at Constant Contact responsible for architecting large-scale data intelligence solutions and evolving an open lakehouse on AWS. Leads technical direction and mentors engineers across distributed teams.

Responsibilities

Architecting large-scale data intelligence solutions, performing architectural assessments, crafting architectural options and analysis around Snowflake Data Warehouse and/or Google BigQuery
Design and evolve an open lakehouse on AWS: S3 with Apache Iceberg/Delta table formats, a medallion architecture (bronze → silver → gold), and Trino as the federated query engine.
Finalize preferred solution alternative working with IT and Business stakeholders to build data ingestion pipeline using tools like AWS EMR, Snowpipe, AWS DMS, etc.etc
Need to have professional knowledge of cloud platforms like AWS, GCP, etc.
Developing ETL pipelines in and out of data the warehouse using but not limited to Python, Scala,SnowSQL, etc.
Own orchestration patterns in Dagster: asset-based pipelines, code-location design, cross-asset lineage, sensors and schedules, partitioning and backfills.
Set dbt standards for the enterprise data model: layering (staging/intermediate/marts), testing, documentation, and CI for model changes.
Hands on experience with building productionized data ingestion and processing pipelines using Java, Spark, Scala, Python
In-depth understanding of Data Warehouse/ODS, ETL concept and modeling structure principles
Tune Trino for performance and cost: query planning, catalog configuration (Glue/Hive/REST), resource groups, and scaling on Kubernetes.
Set technical direction and write architecture decision records for review by peers and leadership.
Mentor engineers across distributed teams in the US and India, and raise the bar through code and design reviews.

Qualification

Strong data modelingExperience with Kubernetes (EKS)Performing in an agileNice to have

Required

12+ years of experience working with data in the following ways: SQL development, Shell Scripting, Python, Snowflake, AWS, software engineering or database development
Ideal candidate has led platform architecture for a multi-team data organization
Experience developing end-to-end data pipelines to transform and process data for reporting layer
Experience with large-scale data sets using both structured and unstructured data
Production experience with at least two of: Trino/Presto, Iceberg/Delta/Hudi, Dagster/Airflow, dbt, Spark
Full grasp of continuous integration and delivery, including branching strategies, automated deployment and functional automation within CI and CD Pipelines
Strong communication skills across both business and technical communities
Strong data modeling: dimensional/Kimball, conformed dimensions, slowly changing dimensions (SCDs), and modeling for multiple brands or tenants
Experience with Kubernetes (EKS), infrastructure as code (Terraform/CDK), and containerized data services
Bachelor or Master’s degree in Computer Science, Information Technology or Equivalent
Performing in an agile, self-directed team environment
Nice to have: experience with semantic layers (Cube, dbt Semantic Layer), data catalogs, ML/identity resolution, marketing or ad-tech data, and big data

Benefits

PTO
Flexible Work

Company

Constantcontact

View company page

Source: greenhouse

Active within the past hour

Remote-friendly

More roles at Constantcontact

Director/Principal, Product Marketing

Remote - US

Communications Manager

Remote - US

Principal Product Designer

Remote - US

Boost Your Interview Chances

Improve Resume Match Score

Free

Your Score

9.0

Strong Applicant

Must-Have Skills for This Role

SnowflakeGoogle BigQueryAWSS3Apache IcebergDelta table formats

Optimize my Resume

Apply Faster with Autofill

Free

Save your profile once. LumiJobs pre-fills the employer's application form so you stop re-typing the same answers on every site.

Apply With Autofill

Or skip LumiJobs's tools and submit directly on the employer's career site.

Apply on Employer Site

Principal Data Engineer at Constantcontact · LumiJobs