CapTech
Lead Data Engineer (AWS, Azure, GCP)
CapTech, Chicago, Illinois, United States, 60290
Job Description
CapTech Data Engineering consultants enable clients to build and maintain advanced data systems that bring together data from disparate sources in order to enable decision-makers. We build pipelines and prepare data for use by data scientists, data analysts, and other data systems. Cloud Data Engineers leverage the client’s cloud infrastructure to deliver this value today and to scale for the future. We enjoy a collaborative environment and have many opportunities to learn from and share knowledge with other developers, architects, and our clients.Qualifications
Experience building/operating highly available distributed systems of data extraction, ingestion, and processing large data sets5+ years of experience delivering data engineering solutions on cloud platform5+ years of experience implementing modern designs using at least one cloud-based solution/platform (AWS, Azure, GCP)Advanced level proficiency with at least one ETL / Data Orchestration technology (Azure Data Factory, SSIS, Informatica, Alteryx, Ab Initio, Pentaho, Talend, Matillion)Experience with cloud-based data warehousing and data lake solutions like Snowflake, Redshift, Databricks5+ years of experience with SQL or NoSQL database (PostgreSQL, MySQL, SQL server, Oracle, Aurora, Presto, BigQuery)Expertise with SQL, database design/structure and data structure (star, snowflake schemas, de/normalized designs)5+ years of experience with at least one programming language (Python, Java, R, C / C# / C++, Shell)Familiarity with one or more DevOps tools (git, Jenkins, CI/CD, Jira)Fundamental understanding of big data, open source, and data streaming conceptsAbility to think strategically and provide recommendations utilizing traditional and modern architectural components based on business needsExperience providing technical leadership and mentoring other engineers in data engineering spaceCloud certification on any platform a plus
#J-18808-Ljbffr
CapTech Data Engineering consultants enable clients to build and maintain advanced data systems that bring together data from disparate sources in order to enable decision-makers. We build pipelines and prepare data for use by data scientists, data analysts, and other data systems. Cloud Data Engineers leverage the client’s cloud infrastructure to deliver this value today and to scale for the future. We enjoy a collaborative environment and have many opportunities to learn from and share knowledge with other developers, architects, and our clients.Qualifications
Experience building/operating highly available distributed systems of data extraction, ingestion, and processing large data sets5+ years of experience delivering data engineering solutions on cloud platform5+ years of experience implementing modern designs using at least one cloud-based solution/platform (AWS, Azure, GCP)Advanced level proficiency with at least one ETL / Data Orchestration technology (Azure Data Factory, SSIS, Informatica, Alteryx, Ab Initio, Pentaho, Talend, Matillion)Experience with cloud-based data warehousing and data lake solutions like Snowflake, Redshift, Databricks5+ years of experience with SQL or NoSQL database (PostgreSQL, MySQL, SQL server, Oracle, Aurora, Presto, BigQuery)Expertise with SQL, database design/structure and data structure (star, snowflake schemas, de/normalized designs)5+ years of experience with at least one programming language (Python, Java, R, C / C# / C++, Shell)Familiarity with one or more DevOps tools (git, Jenkins, CI/CD, Jira)Fundamental understanding of big data, open source, and data streaming conceptsAbility to think strategically and provide recommendations utilizing traditional and modern architectural components based on business needsExperience providing technical leadership and mentoring other engineers in data engineering spaceCloud certification on any platform a plus
#J-18808-Ljbffr