Sonoma Consulting Inc.
Senior Data Engineer
Sonoma Consulting Inc., Chicago, Illinois, United States, 60290
Halo Group is a premier provider of IT talent. We place technology experts withinthe teams of the world’s leading companies to help them build innovativebusinesses that keep them one step closer to their customers and one stepahead of the competition. We offer a meaningful work environment foremployees, attractive and interesting engagements for consultants, and cutting-edgedigital innovation for our customers.
We delight in helping our customers execute their digital vision. Big projects orsmall, Halo Group knows that by combining the highest quality talent with ourunwavering support, we will become an invaluable extension of the team. HaloGroup's experienced consultants in Detroit, Atlanta and Dallas specialize in allareas of product/project governance, UX/UI, multi-platform applications, qualityassurance/testing, cloud computing, and data analytics.
Since its inception, Halo Group has been recognized for numerous awards, including:
- INC 5000- Future 50- 101 Best and Brightest- Michigan 50 Companies to Watch- Goldline Research - “Most Dependable Companies”- Ernst & Young - “Entrepreneur of the Year” Finalist
Job Description
Description:Looking for a Senior Data Engineer to be part of our Engineering Team. As a Senior Data Engineer, you will be part of the core team that is responsible for empowering the company with data. The position will be working on our transactional, streaming, and analytics platform ensuring the tools and systems are designed for scale to help our engineers, product managers and analysts make better decisions and drive insights with data. The individual has a background in distributed applications, data streaming and NoSQL and SQL databases.Responsibilities:Select, build and configure solutions that use open source platforms and tools such as Kafka, Nifi, Hive, Map Reduce alongside NoSQL technologies to enable reliable, trustworthy, and approachable data and tune them for performance at scale.Help our analysts and engineers build and optimize data pipelines to understand our large and ever-growing user base and make better decisions.Implement data pipelines to automate the ingestion, transformation, and augmentation of both structured and unstructured data sources, and provide best practices for pipeline operations.Work with Business Analysts, Application Developers and Data Scientists to implement solutions using agile methodologies.Qualifications
Skills & Qualifications2+ years of experience in handling large datasets working with a messaging system such as Apache Kafka, Rabbit MQ, or other streaming processing tools with technologies like Spark Streaming or Flink, and NoSQL datastores.5+ years of high availability, concurrent, large-scale distributed infrastructures7+ years of strong programming expertise in Java, Python, SQL3+ years working in a highly collaborative environmentExpertise in leading cloud technologies like Amazon Web ServicesAbility to communicate technical concepts, possibilities, and limitations to a non-technical audience (product managers, designers)High attention to detail and constructive attitude in peer code reviewsBachelor’s in Computer Science, Computer Engineering or comparable experienceAdditional Information
** U.S. Citizens and those who are authorized to work independently in the United States are encouraged to apply. We are unable to sponsor at this time.This is a Full-Time / Permanent job opportunity.Only for US Citizen and Green Card Holder, EAD Holders, GC EAD, Canadian Citizen** All your information will be kept confidential according to EEO guidelines.Skills: Apache Kafka, Rabbit MQ, NoSQL datastores, Java, Python, SQL, Amazon Web Services
#J-18808-Ljbffr
We delight in helping our customers execute their digital vision. Big projects orsmall, Halo Group knows that by combining the highest quality talent with ourunwavering support, we will become an invaluable extension of the team. HaloGroup's experienced consultants in Detroit, Atlanta and Dallas specialize in allareas of product/project governance, UX/UI, multi-platform applications, qualityassurance/testing, cloud computing, and data analytics.
Since its inception, Halo Group has been recognized for numerous awards, including:
- INC 5000- Future 50- 101 Best and Brightest- Michigan 50 Companies to Watch- Goldline Research - “Most Dependable Companies”- Ernst & Young - “Entrepreneur of the Year” Finalist
Job Description
Description:Looking for a Senior Data Engineer to be part of our Engineering Team. As a Senior Data Engineer, you will be part of the core team that is responsible for empowering the company with data. The position will be working on our transactional, streaming, and analytics platform ensuring the tools and systems are designed for scale to help our engineers, product managers and analysts make better decisions and drive insights with data. The individual has a background in distributed applications, data streaming and NoSQL and SQL databases.Responsibilities:Select, build and configure solutions that use open source platforms and tools such as Kafka, Nifi, Hive, Map Reduce alongside NoSQL technologies to enable reliable, trustworthy, and approachable data and tune them for performance at scale.Help our analysts and engineers build and optimize data pipelines to understand our large and ever-growing user base and make better decisions.Implement data pipelines to automate the ingestion, transformation, and augmentation of both structured and unstructured data sources, and provide best practices for pipeline operations.Work with Business Analysts, Application Developers and Data Scientists to implement solutions using agile methodologies.Qualifications
Skills & Qualifications2+ years of experience in handling large datasets working with a messaging system such as Apache Kafka, Rabbit MQ, or other streaming processing tools with technologies like Spark Streaming or Flink, and NoSQL datastores.5+ years of high availability, concurrent, large-scale distributed infrastructures7+ years of strong programming expertise in Java, Python, SQL3+ years working in a highly collaborative environmentExpertise in leading cloud technologies like Amazon Web ServicesAbility to communicate technical concepts, possibilities, and limitations to a non-technical audience (product managers, designers)High attention to detail and constructive attitude in peer code reviewsBachelor’s in Computer Science, Computer Engineering or comparable experienceAdditional Information
** U.S. Citizens and those who are authorized to work independently in the United States are encouraged to apply. We are unable to sponsor at this time.This is a Full-Time / Permanent job opportunity.Only for US Citizen and Green Card Holder, EAD Holders, GC EAD, Canadian Citizen** All your information will be kept confidential according to EEO guidelines.Skills: Apache Kafka, Rabbit MQ, NoSQL datastores, Java, Python, SQL, Amazon Web Services
#J-18808-Ljbffr