Diverse Lynx
Sr Data Engineer
Diverse Lynx, Phila, Pennsylvania, United States, 19117
Job Title: Sr Data Engineer
Location:
Philadelphia, PA (100% Onsite role from Day 1)
Duration: Full Time/Permanent
Job Description:
Relevant Experience
(in Yrs) 10-12 years
Technical/Functional Skills Scala Spark, Python, Big Data, Kafka, AWS, Oracle SQL, Hive SQL, Databricks, and Jenkins,
Experience Required 10 - 12 Years
Roles & ResponsibilitiesHands-on architecture/development of ETL pipelines using our internal framework written in Java.Hands-on architecture of real time REST APIs or other solutions for streaming data from Graph using SparkInterpret data, analyze results using statistical techniques and provide ongoing reports.Develop and implement databases, data collection systems, data analytics and other strategies that optimize statistical efficiency and quality.Experienced with DatabricksAcquire data from primary or secondary data sources and maintain databases/data systems.Identify, analyze, and interpret trends or patterns in complex data sets.Filter and clean data by reviewing reports and performance indicators to locate and correct problems.Work with management to prioritize business and information needs.Locate and define new process improvement opportunities
Generic Managerial Skills Motivated team player with excellent communication, interpersonal, analytical and problem solving skills
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Location:
Philadelphia, PA (100% Onsite role from Day 1)
Duration: Full Time/Permanent
Job Description:
Relevant Experience
(in Yrs) 10-12 years
Technical/Functional Skills Scala Spark, Python, Big Data, Kafka, AWS, Oracle SQL, Hive SQL, Databricks, and Jenkins,
Experience Required 10 - 12 Years
Roles & ResponsibilitiesHands-on architecture/development of ETL pipelines using our internal framework written in Java.Hands-on architecture of real time REST APIs or other solutions for streaming data from Graph using SparkInterpret data, analyze results using statistical techniques and provide ongoing reports.Develop and implement databases, data collection systems, data analytics and other strategies that optimize statistical efficiency and quality.Experienced with DatabricksAcquire data from primary or secondary data sources and maintain databases/data systems.Identify, analyze, and interpret trends or patterns in complex data sets.Filter and clean data by reviewing reports and performance indicators to locate and correct problems.Work with management to prioritize business and information needs.Locate and define new process improvement opportunities
Generic Managerial Skills Motivated team player with excellent communication, interpersonal, analytical and problem solving skills
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.