Dice
Senior Data Engineer
Dice, Little Ferry, New Jersey, us, 07643
Dice is the leading career destination for tech experts at every stage of their careers. Our client, Avenue Code, LLC, is seeking the following. Apply via Dice today!
We are seeking a highly experienced Data Engineer with exposure to lead role or help other data engineers. The ideal candidate will possess a deep knowledge of Python, Java, Kafka, Spark, Flink, Elasticsearch, and graph data technologies. This role requires strong debugging and systems knowledge to ensure high availability and performance of our data systems and to efficiently address production issues. This is a remote position based in the US. There will be on-call rotations to address high-priority production issues and maintain system uptime.
Responsibilities:
Lead a team of data engineers in designing, building, and maintaining advanced data pipelines and architectures.Act as a subject matter expert in production system operations, including monitoring, debugging, and resolving production issues efficiently.Implement real-time and batch data processing solutions using Kafka, Spark, Flink, and other relevant technologies.Leverage Elasticsearch to enhance search and analytics capabilities, ensuring optimal performance and scalability.Utilize graph and vector databases and fine-tune language models (LLMs) to support innovative data applications.Collaborate with global engineering teams, particularly in the India Time Zone, to manage cross-functional projects and initiatives.Provide technical guidance and mentorship, fostering a culture of continuous improvement and learning within the team.Develop and enforce best practices for data quality, reliability, and systems security.Participate in on-call rotations to address high-priority production issues and maintain system uptime.Qualifications:
Strong experience in data engineering.Expert proficiency in programming languages such as Python or Java, with a strong background in data processing and analytics.Deep understanding of Kafka, Spark, Flink, and Elasticsearch, with hands-on experience in production environments.Experience with graph databases, graph algorithms, and NLP techniques, including LLM fine-tuning.Strong debugging skills and experience with production system operations, including performance tuning and troubleshooting.Excellent communication and collaboration skills, with the ability to work effectively across time zones and cultures.
#J-18808-Ljbffr
We are seeking a highly experienced Data Engineer with exposure to lead role or help other data engineers. The ideal candidate will possess a deep knowledge of Python, Java, Kafka, Spark, Flink, Elasticsearch, and graph data technologies. This role requires strong debugging and systems knowledge to ensure high availability and performance of our data systems and to efficiently address production issues. This is a remote position based in the US. There will be on-call rotations to address high-priority production issues and maintain system uptime.
Responsibilities:
Lead a team of data engineers in designing, building, and maintaining advanced data pipelines and architectures.Act as a subject matter expert in production system operations, including monitoring, debugging, and resolving production issues efficiently.Implement real-time and batch data processing solutions using Kafka, Spark, Flink, and other relevant technologies.Leverage Elasticsearch to enhance search and analytics capabilities, ensuring optimal performance and scalability.Utilize graph and vector databases and fine-tune language models (LLMs) to support innovative data applications.Collaborate with global engineering teams, particularly in the India Time Zone, to manage cross-functional projects and initiatives.Provide technical guidance and mentorship, fostering a culture of continuous improvement and learning within the team.Develop and enforce best practices for data quality, reliability, and systems security.Participate in on-call rotations to address high-priority production issues and maintain system uptime.Qualifications:
Strong experience in data engineering.Expert proficiency in programming languages such as Python or Java, with a strong background in data processing and analytics.Deep understanding of Kafka, Spark, Flink, and Elasticsearch, with hands-on experience in production environments.Experience with graph databases, graph algorithms, and NLP techniques, including LLM fine-tuning.Strong debugging skills and experience with production system operations, including performance tuning and troubleshooting.Excellent communication and collaboration skills, with the ability to work effectively across time zones and cultures.
#J-18808-Ljbffr