Senior Data Engineer

About Annalect Annalect is the Data & Technology arm of Omnicom Media Group Annalect's 2,000 innovators leverage data and technology to help clients across Omnicom build relationships that matter - whether that means fostering consumers' trust in brands, building new experiences, or delivering advanced analytics where it's most needed. Annalect is the driving force behind Omni, Omnicom's unique open operating system, which works hand-in-hand with clients' and partners' data and tools, to orchestrate better marketing outcomes. Annalect's unique approach to data and technology - one that relies on transparency, neutrality, and interoperability - allows us to deliver purpose-built and scalable solutions that make data actionable. Our advanced teams of product leaders, data scientists, consultants, and engineers enable us to meet the business goals of our internal and external clients. Position Overview Annalect is currently seeking a data engineer to join our technology team. In this role you will build Annalect products which sit atop cloud-based data infrastructure. We are looking for people who have a shared passion for technology, design & development, data, and fusing these disciplines together to build cool things. In this role, you will work on one or more software and data products in the Annalect Engineering Team. You will participate in technical architecture, design and development of software products as well as research and evaluation of new technical solutions. Key Responsibilities Steward data and compute environments to facilitate usage of data assets Design, build, test and deploy scalable and reusable systems that handle large amounts of data Manage small team of developers Perform code reviews and provide leadership and guidance to junior developers Learn and teach new technologies Required Skills Experience designing and managing data flows Experience designing systems and APIs to integrate data into applications 8 years of Linux, Bash, Python, and SQL experience 4 years using Spark and other Hadoop ecosystem software 4 years using AWS cloud services, esp. EMR, Glue, Athena, and Redshift 4 years managing team of developers Passion for Technology: Excitement for new technology, bleeding edge applications, and a positive attitude towards solving real world challenges Additional Skills BS, MS or PhD in Computer Science, Engineering, or equivalent real-world experience (You've learned something to be able to claim you are an engineer) Significant experience with Python, C++, or other popular language Experience with big data and/or infrastructure. Bonus for having experience in setting up Petabytes of data so they can be easily accessed. Understanding of data organization, i.e., partitioning, clustering, file sizes, file formats. Data cataloging with Hive/Hive meta store or Glue or something similar. Experience working with relational databases. Experience with Hadoop, Hive, Spark, or other data processing tools Experience in any of the modern data stack technologies like dbt , airbyte is desired. Experience building scalable data pipelines (Airflow experience a plus) Significant experience working with AWS and/or GCP Proven ability to independently execute projects from concept to implementation to launch and to maintain a live product Perks of working at Annalect Culture We have an incredibly fun, collaborative environment that encourages engagement and work/life balance Generous PTO that includes vacation days, personal days, a fantastic Summer Friday program and extended time off around the holiday season. As part of Omnicom, we have the backing and resources of a global billion-dollar company, but also have the flexibility and pace of a "startup" - we move fast, break things, and innovate. This is the pay range the Company believes it will pay for this position at the time of this posting. Consistent with applicable law, compensation will be determined based on relevant experience, other job-related qualifications/skills, and geographic location (to account for comparative cost of living). The Company reserves the right to modify this pay range at any time. For this role, benefits include: health insurance, vision insurance, dental insurance, 401(k), Healthcare Flexible Spending Account, Dependent Care Flexible Spending Account, vacation days, sick days, personal days, paid parental leave, paid medical leave, and STD/LTD insurance benefits. Compensation Range $126,000-$180,000 USD This role is hybrid, requiring three (3) days per week in the office. The remaining two (2) days may be worked remotely. Specific in-office days will be discussed during the interview process, with flexibility to align with team needs. Please note that the number or required in-office days may be adjusted over time, potentially increasing the number of required in-office days based on business needs. Annalect, a division of Omnicom Media Group is An Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or veteran status, age or any other federally protected class. Review Our Recruitment Privacy Notice