Data Engineer

Develop data integration systems and scope out business requirements; integrate data generated by several, new advertising-based projects into our petabyte-scale data warehouse; refactor Python- and Go-based tools to help in automatically deploying, testing, and monitoring the quality of hundreds of data pipelines; work closely with data scientists and engineers to categorize, document, and analyze Kargo's new and existing advertising data streams; mine data directly from primary sources; build solid pipelines that deliver value to business using standard data warehousing concepts; create modify and monitor Airflow DAGs for 24-7 operation of the central data warehouse; identify opportunities for process improvement, recommend system modifications, and help develop new tools and processes for data lineage; assist in implementing data governance policies and tools; work with business stakeholders to build and organize reports within Looker Bl; improve data transformations and data consumption processes so that the company's systems are running efficiently; ensure quick and effective use of the company's data by consumers; write complex SQL queries to analyze and transform data; and access third party APls and utilize Python or UI based ETLservices to GET and POST data. Requirements: Bachelor’s degree in Computer Science, Information Systems, Electronics Engineering, or a closely related field. Three years of software engineering-related experience Experience with unit testing, documentation, quality assurance, and code reviews. Knowledge of Python. Experience in cloud service platforms, such as GCP or AWS. Experience in SQL. Experience with data and transformation queries. Experience with big data structures and platforms such as Apache Spark, Google BigQuery, Amazon Redshift, or Snowflake.

Minimum Salary: 111966 Maximum Salary: 140000 Salary Unit: Yearly