Logo
Diverse Lynx

Sr Data Engineer

Diverse Lynx, Phila, Pennsylvania, United States, 19117


Job Title: Sr Data Engineer

Location:

Philadelphia, PA (100% Onsite role from Day 1)

Duration: Full Time/Permanent

Job Description:

Relevant Experience

(in Yrs) 10-12 years

Technical/Functional Skills Scala Spark, Python, Big Data, Kafka, AWS, Oracle SQL, Hive SQL, Databricks, and Jenkins,

Experience Required 10 - 12 Years

Roles & ResponsibilitiesHands-on architecture/development of ETL pipelines using our internal framework written in Java.Hands-on architecture of real time REST APIs or other solutions for streaming data from Graph using SparkInterpret data, analyze results using statistical techniques and provide ongoing reports.Develop and implement databases, data collection systems, data analytics and other strategies that optimize statistical efficiency and quality.Experienced with DatabricksAcquire data from primary or secondary data sources and maintain databases/data systems.Identify, analyze, and interpret trends or patterns in complex data sets.Filter and clean data by reviewing reports and performance indicators to locate and correct problems.Work with management to prioritize business and information needs.Locate and define new process improvement opportunities

Generic Managerial Skills Motivated team player with excellent communication, interpersonal, analytical and problem solving skills

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.