Hadoop Developer

Insight Global is looking for a Hadoop Developer to join one of our large financial clients. They will be implementing Hadoop from scratch; and developing and maintaining data pipelines using Pyspark to ingest, process, and transform large volumes of data from various sources (both structured and unstructured). They will be solving L3 production issues and performing root cause analysis. They will work closely with the regulatory reporting team to ensure data accuracy, consistency, and compliance. They will also generate reports and dashboards using Pyspark and other relevant tools, as well as collaborate on data quality checks and validation processes.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal. com.

To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .Linux experience5+ years of Hadoop development experience including HDFS5+ years of Pyspark experienceSQL experienceData warehouse or data lake understand