Principal Data Engineer, fully remote, other levels available, 145k to 195k

Principal Data Engineer, fully remote, other levels available, 145k to 195k base, bonus, optionsCompensation Commensurate with experience, bonus, benefits, EOE, diverse highly educated culture. Candidates must be a U.S. citizen or national, refugee, asylum, or lawful permanent residents. Highly qualified H1b candidates will be considered, no other visas can be supported.SummaryOur client is seeking a Principal Data Engineer to join its Data Engineering team.This individual will play a major role in shaping the team’s technical direction, designing, and implementing the data architecture to enable analytics, data science, and machine learning at scale.ResponsibilitiesThe ideal candidate will also serve as a mentor to other data engineers, investing in the team’s development together. This position is a hands-on engineering role, with the core focus being on developing and deploying production-grade code.Takes a hands-on role at piloting and developing tools in addition to enhancing existing platforms that power Our client’s data teamsArchitect and implement large-scale data processing systems that enable analytics, data science, and machine learning in a multi-cloud environmentDevelop best practices for data collection, storage, and processing that impact company-wide data strategy across Our client’s data lakes and data warehousesPartner with software and analytics engineering teams to establish data contracts to improve data quality at every stage of the data lifecycleParticipate in design and architectural review sessions with data engineers and software engineering partnersConduct code reviews and knowledge-sharing sessions across data engineering and partner teamsCollaborate with engineering and product leadership to translate business requirements into technical solutionsPartner with engineering teams to model foundational event schemasQualificationsProficiency in Python, SQL, RESTful API developmentExperience in data engineering role building end-to-end ETL/ELT pipelines, Experience developing real-time data pipelines using frameworks such as Apache Beam, Flink, Storm, Spark Streaming, Experience building batch data pipelines using DAG-based tools such as Dagster or AirflowExperience with data warehouses, data lakes, and their underlying infrastructureExperience with cloud computing platforms such as Azure, AWSExperience data observability and monitoring tooling such as Monte Carlo, Great Expectations, SodaSQL, Databand, etc.Experience in producing and consuming topics to/from Apache Kafka, AWS Kinesis, or Azure Event HubsExperience with data governance, schema design, and schema evolutionExperience implementing DevOps best practices within the data platform, including solutions for CI/CD, data observability, monitoring, and lineage, Experience with Infrastructure as code tools such as TerraformDiversity and EOE StatementsOur clients are committed to an inclusive workplace where we do not discriminate based on race, sex, gender, national origin, religion, sexual orientation, gender identity, marital or familial status, age, ancestry, disability, genetic information, or any other characteristic protected by applicable laws. They believe in diversity and encourage any qualified individual to apply. They are an equal employment opportunity employer.BlueSkyClarity proudly believe that your gender, race, nationality, religion, sexual orientation, status as a protected veteran, or status as an individual with a disability should have nothing to do with hiring practices. We are an EOE agency that seeks to increase our client’s diversity recruitment and hiring.Posted byDom Costagliola, Principal, m 1-617-899-5094, domenic@blueskyclarity.comhttp://www.blueskyclarity.com/http://www.linkedin.com/in/domcosta1Type: direct hire