Aditi Consulting
Data Engineer II
Aditi Consulting, Austin, Texas, us, 78716
Summary:The Client is seeking a talented and experienced Data Engineer to join our AWS Marketing Insights team. In this pivotal role, you will be responsible for designing, building, and maintaining robust data pipelines and data infrastructure to support data-driven insights across the organization. You'll design and implement high-performance, scalable, and cost-efficient data storage solutions. Utilizing CI/CD principles, you'll automate infrastructure deployment and maintenance processes, ensuring a streamlined data ecosystem. Data modeling and engineering will be crucial, involving designing and implementing optimized data models, developing and maintaining ETL processes, and collaborating with analysts and functional managers to understand data needs and provide tailored data structures.
Ensuring data governance, security, and compliance will be paramount. You'll implement robust policies and processes, enforce access controls, encryption, and auditing mechanisms, and collaborate cross-functionally to establish and maintain data governance standards. Continuous improvement and automation will be woven into your daily activities, continuously evaluating and optimizing processes, pipelines, and infrastructure, implementing automation and monitoring tools, and staying ahead of emerging data engineering technologies and trends.
KEY JOB RESPONSIBILITIES:
As a Data Engineer on the AWS Marketing Insights team, your pivotal role will revolve around designing, building, and maintaining robust data pipelines and infrastructure to drive data-driven insights.Core responsibilities include architecting scalable and fault-tolerant pipelines to extract, transform, and load data from various sources into data warehouses or lakes.Leveraging cutting-edge tools and technologies, you'll implement ingestion, transformation, and integration processes, ensuring stringent data quality through validation, cleansing, and deduplication.You will be developing and supporting the analytic technologies that give our customers timely, flexible and structured access to their data.You will be responsible for designing and implementing a platform using third-party and in-house reporting tools, modeling metadata, building reports and dashboards using distributed systems.You will work with business customers in understanding the business requirements and implementing solutions to support analytical and reporting needs.
BASIC QUALIFICATIONS:
3+ years of data engineering experience - Experience with data modeling, warehousing and building ETL pipelinesKnowledge of professional software engineering & best practices for full software development life cycle, including coding standards, software architectures, code reviews, source control management, continuous deployments, testing, and operational excellence - Knowledge of distributed systems as it pertains to data storage and computingExperience with SQLA good candidate can partner with business owners directly to understand their requirements and provide data which can help them observe patterns and spot anomalies.Bachelor's degree in computer science, engineering, analytics, mathematics, statistics, IT or equivalent
PREFERRED QUALIFICATIONS:
Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissionsExperience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)Master's degree in computer science, engineering, analytics, mathematics, statistics, IT or equivalentExperience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS - Experience building world-class data environments with a high emphasis on data quality and data securityStrong problem-solving and analytical skills, with the ability to translate business requirements into technical solutions
Compensation:The pay rate range above is the base hourly pay range that Aditi Consulting reasonably expects to pay someone for this position (compensation may vary outside of this range depending on a number of factors, including but not limited to, a candidate's qualifications, skills, competencies, experience, location and end client requirements).
Benefits and Ancillaries:Medical, dental, vision, PTO benefits and ancillaries may be available for eligible Aditi Consulting employees and vary based on the plan options selected by the employee.
Aditi Consulting LLC uses AI technology to engage candidates during the sourcing process. AI technology is used to gather data only and does not replace human-based decision making in employment decisions.
Ensuring data governance, security, and compliance will be paramount. You'll implement robust policies and processes, enforce access controls, encryption, and auditing mechanisms, and collaborate cross-functionally to establish and maintain data governance standards. Continuous improvement and automation will be woven into your daily activities, continuously evaluating and optimizing processes, pipelines, and infrastructure, implementing automation and monitoring tools, and staying ahead of emerging data engineering technologies and trends.
KEY JOB RESPONSIBILITIES:
As a Data Engineer on the AWS Marketing Insights team, your pivotal role will revolve around designing, building, and maintaining robust data pipelines and infrastructure to drive data-driven insights.Core responsibilities include architecting scalable and fault-tolerant pipelines to extract, transform, and load data from various sources into data warehouses or lakes.Leveraging cutting-edge tools and technologies, you'll implement ingestion, transformation, and integration processes, ensuring stringent data quality through validation, cleansing, and deduplication.You will be developing and supporting the analytic technologies that give our customers timely, flexible and structured access to their data.You will be responsible for designing and implementing a platform using third-party and in-house reporting tools, modeling metadata, building reports and dashboards using distributed systems.You will work with business customers in understanding the business requirements and implementing solutions to support analytical and reporting needs.
BASIC QUALIFICATIONS:
3+ years of data engineering experience - Experience with data modeling, warehousing and building ETL pipelinesKnowledge of professional software engineering & best practices for full software development life cycle, including coding standards, software architectures, code reviews, source control management, continuous deployments, testing, and operational excellence - Knowledge of distributed systems as it pertains to data storage and computingExperience with SQLA good candidate can partner with business owners directly to understand their requirements and provide data which can help them observe patterns and spot anomalies.Bachelor's degree in computer science, engineering, analytics, mathematics, statistics, IT or equivalent
PREFERRED QUALIFICATIONS:
Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissionsExperience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)Master's degree in computer science, engineering, analytics, mathematics, statistics, IT or equivalentExperience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS - Experience building world-class data environments with a high emphasis on data quality and data securityStrong problem-solving and analytical skills, with the ability to translate business requirements into technical solutions
Compensation:The pay rate range above is the base hourly pay range that Aditi Consulting reasonably expects to pay someone for this position (compensation may vary outside of this range depending on a number of factors, including but not limited to, a candidate's qualifications, skills, competencies, experience, location and end client requirements).
Benefits and Ancillaries:Medical, dental, vision, PTO benefits and ancillaries may be available for eligible Aditi Consulting employees and vary based on the plan options selected by the employee.
Aditi Consulting LLC uses AI technology to engage candidates during the sourcing process. AI technology is used to gather data only and does not replace human-based decision making in employment decisions.