Compunnel
Lead Data Engineer
Compunnel, Nashville, Tennessee, United States, 37247
Job Summary:
We are seeking an experienced Lead Data Engineer to join our team and drive the development and optimization of our data infrastructure. The ideal candidate will have a strong background in data engineering, API integration, and database management, especially in cloud-based environments. You will work with various AWS services, implement best practices in software development, and ensure the secure, efficient handling of data across our systems.
Key Responsibilities:
• Develop and maintain scalable data pipelines and APIs for seamless data integration.
• Design, implement, and optimize database applications using AWS services like Redshift and Aurora PostgreSQL.
• Utilize AWS serverless technologies, including Lambda, Glue, and EventBridge, to manage data workflows.
• Implement cloud security best practices and support cloud migration efforts.
• Design data solutions using AWS Step Functions, CloudWatch, and CloudFront to enhance system reliability.
• Work with languages such as SQL/NoSQL, Python, and Node.js to build robust data applications.
• Apply CI/CD practices for code management and deployment to ensure continuous integration and delivery.
• Collaborate with cross-functional teams using Agile methodologies, including SAFE and Scrum.
Required Qualifications:
• 3–5+ years of experience in Data Engineering, with strong knowledge of API development and database management.
• Expertise in object-oriented programming and design.
• Proven experience with AWS services including Redshift, Aurora PostgreSQL, Lambda, Glue, EventBridge, CloudWatch, and CloudFront.
• Proficiency in SQL/NoSQL databases, Python, Node.js, and JavaScript libraries like Chart.js.
• Familiarity with cloud migration, cloud security, and DevOps practices.
Preferred Qualifications:
• Hands-on experience with PySpark.
• Knowledge of modern software development methodologies, including CI/CD, Agile, SAFE, and Scrum.
Education:
Bachelors Degree
We are seeking an experienced Lead Data Engineer to join our team and drive the development and optimization of our data infrastructure. The ideal candidate will have a strong background in data engineering, API integration, and database management, especially in cloud-based environments. You will work with various AWS services, implement best practices in software development, and ensure the secure, efficient handling of data across our systems.
Key Responsibilities:
• Develop and maintain scalable data pipelines and APIs for seamless data integration.
• Design, implement, and optimize database applications using AWS services like Redshift and Aurora PostgreSQL.
• Utilize AWS serverless technologies, including Lambda, Glue, and EventBridge, to manage data workflows.
• Implement cloud security best practices and support cloud migration efforts.
• Design data solutions using AWS Step Functions, CloudWatch, and CloudFront to enhance system reliability.
• Work with languages such as SQL/NoSQL, Python, and Node.js to build robust data applications.
• Apply CI/CD practices for code management and deployment to ensure continuous integration and delivery.
• Collaborate with cross-functional teams using Agile methodologies, including SAFE and Scrum.
Required Qualifications:
• 3–5+ years of experience in Data Engineering, with strong knowledge of API development and database management.
• Expertise in object-oriented programming and design.
• Proven experience with AWS services including Redshift, Aurora PostgreSQL, Lambda, Glue, EventBridge, CloudWatch, and CloudFront.
• Proficiency in SQL/NoSQL databases, Python, Node.js, and JavaScript libraries like Chart.js.
• Familiarity with cloud migration, cloud security, and DevOps practices.
Preferred Qualifications:
• Hands-on experience with PySpark.
• Knowledge of modern software development methodologies, including CI/CD, Agile, SAFE, and Scrum.
Education:
Bachelors Degree