Logo
Diverse Lynx

Python PySpark Developer

Diverse Lynx, Woonsocket, Rhode Island, 02895


Title: Python PySpark Developer Location: Woonsocket, RI - Onsite Duration: 12 Months contract Job Description- Role Description: Support analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics. Support and monitor the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, and GCP 'big data' technologies. Work with data and analytics experts to strive for greater functionality in our data systems. Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs. Developing, supporting and monitoring data pipelines. Work closely with client to Client needs, collect appropriate data, and deliver valuable data products. Provide valuable insights from data sets quickly. Communicate complex findings and ideas in plain language and visualizations that is friendly to business and operational audiences. Competencies: Digital : Python, Digital : PySpark, MySQL Experience (Years): 4-6 Essential Skills: Strong skills in Python Programming Strong Experience in PySpark Experience with data pipeline and workflow management tool: GCP Data Proc, Composer and GCS Strong experience in handling window function in SQL Big Query Experience (may not be expert)To work on data engineering solutions to leverage best practices and industry-leading tools and technologies to profile data, develop efficient ingestion, and build semantic data layers Desirable Skills: Support analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics. Support and monitor the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, and GCP 'big data' technologies. Work with data and analytics experts to strive for greater functionality in our data systems. Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs. Developing, supporting and monitoring data pipelines. Work closely with client to Client needs, collect appropriate data, and deliver valuable data products. Provide valuable insights from data sets quickly. Communicate complex findings and ideas in plain language and visualizations that is friendly to business and operational audiences. Keywords: Python, PySpark and GCP Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.