Senior Data Engineer

Immediate need for a talented Senior Data Engineer. This is a 06+months contract opportunity with long-term potential and is located in Nashville, TN(Onsite). Please review the job description below and contact me ASAP if you are interested.

Job ID: 24-36658

Pay Range: $120000 - $125000/annum. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location).

Key Responsibilities:

• Provides expert content/professional leadership on complex Engineering assignments/projects.
• Designs and develops a consolidated, conformed enterprise data warehouse and data lake which store all critical data across Customer, Provider, Claims, Client and Benefits data.
• Designs, develops and implements methods, processes, tools and analyses to sift through large amounts of data stored in a data warehouse or data mart to find relationships and patterns.
• Participates in the delivery of the definitive enterprise information environment that enables strategic decision-making capabilities across enterprise via an analytics and reporting.
• Exercises considerable creativity, foresight, and judgment in conceiving, planning, and delivering initiatives.
• Uses deep professional knowledge and acumen to advise functional leaders.
• Focuses on providing thought leadership within Information Management but works on broader projects, which require understanding of wider business.
• Recognized internally as a subject matter expert.

Key Requirements and Technology Experience:

• Skills-Experience with Data modelling techniques, AWS Services, Python, Pyspark and ETL.
• Design, develop and maintain ETL platforms for various business use cases which are fault tolerant, highly distributed and robust.
• Analyze large sets of structured and semi structured data for business analytics and ETL design.
• Translate business needs and vision into roadmap, project deliverables and organization strategies.
• Design and implement ETL solutions using leveraging cloud native platforms.
• Collaborate with analytics and business teams to design data models that feed business intelligence tools, increasing data accessibility and encouraging data driven solutions.
• Experience with data modelling techniques for cloud data stores and on prem databases like Teradata, Teradata Vantage (TDV)etc
• Preferred working experience in ETL development in Teradata vantage and data migration from on prem to Teradata vantage.
• Proficiency in SQL, relational and non-relational databases, query optimization and data modelling.
• Experience with source code control systems like Gitlab.
• Experience with large scale distributed relational and NoSQL database systems.
• Good experience on designing and developing data pipelines for data ingestion and transformation using Spark.
• Distributed computing experience using Python, Pyspark.
• Good understanding of spark framework and spark architecture.
• Experience working in Cloud based big data infrastructure.
• Excellent in trouble shooting the performance and data skew issues.
• Must have good understanding of spark run time metrics and tune applications based on metrics.
• Deep knowledge in partitioning, bucketing concepts of data ingestion.
• Good understanding of AWS services like Glue, Athena, S3, Lambda, Cloud formation.
• Preferred working knowledge on the implementation of datalake ETL using AWS glue, Databricks etc.
• Pyspark, Python, AWS services, Teradata Vantage, CI/CD technologies, Terraform, SQL
• Education: Degree in Computer Science, Information Technology, Artificial Intelligence, or a related field.
• Cloud certifications such as AWS Certified Solutions Architect, Google Cloud Professional.
• Cloud Architect are preferred. Strong knowledge of cloud computing concepts.
• Minimum Degree Required: Bachelor's Degree.

Our client is a leading Healthcare Industry, and we are currently interviewing to fill this and other similar contract positions. If you are interested in this position, please apply online for immediate consideration.

Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

By applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here.