JobRialto
Data Engineer
JobRialto, Florham Park, New Jersey, us, 07932
Description:
Senior Data Engineering ETL Developer who will be responsible for designing and implementing robust ETL pipelines, integrating AWS services such as Redshift and S3, and developing telemetry dashboards that provide insightful analytics on developer activities.
Key Responsibilities:
Design, develop, and maintain scalable and efficient ETL pipelines.
Integrate various data sources into AWS Redshift for advanced analytical processing.
Utilize AWS S3 for secure and scalable storage of large datasets.
Develop telemetry dashboards to monitor and visualize developer activities and system performance.
Work closely with the development team to understand their needs and provide actionable insights through data analytics.
Ensure data integrity and compliance with company standards and practices.
Optimize data retrieval and develop dashboards for performance monitoring.
Collaborate with IT and security teams to establish robust data governance and security policies.
Document all data engineering procedures and solutions for maintenance and scalability.
Required Skills and Qualifications:
Bachelor's or master's degree in computer science, Data Science, Engineering, or a related field.
At least 10 years of experience in data engineering with a strong focus on ETL development.
Proficiency with AWS cloud services, particularly Redshift and S3.
Experience in building telemetry dashboards using tools like Power BI, or similar.
Strong understanding of SQL including optimization techniques.
Knowledge of programming languages such as Python, Java, or Scala.
Excellent problem-solving skills and the ability to work under minimal supervision.
Strong communication and collaboration skills.
Desirable Skills:
Experience with real-time data processing frameworks like Apache Kafka or Spark Streaming.
Familiarity with DevOps practices and tools.
Certification in AWS data technologies or similar.
Education:
Bachelors Degree
Senior Data Engineering ETL Developer who will be responsible for designing and implementing robust ETL pipelines, integrating AWS services such as Redshift and S3, and developing telemetry dashboards that provide insightful analytics on developer activities.
Key Responsibilities:
Design, develop, and maintain scalable and efficient ETL pipelines.
Integrate various data sources into AWS Redshift for advanced analytical processing.
Utilize AWS S3 for secure and scalable storage of large datasets.
Develop telemetry dashboards to monitor and visualize developer activities and system performance.
Work closely with the development team to understand their needs and provide actionable insights through data analytics.
Ensure data integrity and compliance with company standards and practices.
Optimize data retrieval and develop dashboards for performance monitoring.
Collaborate with IT and security teams to establish robust data governance and security policies.
Document all data engineering procedures and solutions for maintenance and scalability.
Required Skills and Qualifications:
Bachelor's or master's degree in computer science, Data Science, Engineering, or a related field.
At least 10 years of experience in data engineering with a strong focus on ETL development.
Proficiency with AWS cloud services, particularly Redshift and S3.
Experience in building telemetry dashboards using tools like Power BI, or similar.
Strong understanding of SQL including optimization techniques.
Knowledge of programming languages such as Python, Java, or Scala.
Excellent problem-solving skills and the ability to work under minimal supervision.
Strong communication and collaboration skills.
Desirable Skills:
Experience with real-time data processing frameworks like Apache Kafka or Spark Streaming.
Familiarity with DevOps practices and tools.
Certification in AWS data technologies or similar.
Education:
Bachelors Degree