SysMind Tech
Sr. PySpark Data Engineer
SysMind Tech, Phila, Pennsylvania, United States, 19117
1. Hands-on architecture/development of ETL pipelines using our internal framework written in Java
2. Hands-on architecture of real time REST APIs or other solutions for streaming data from Graph using Spark
3. Interpret data, analyze results using statistical techniques and provide ongoing reports
4. Develop and implement databases, data collection systems, data analytics and other strategies that optimize statistical efficiency and quality
5. Acquire data from primary or secondary data sources and maintain databases/data systems
6. Identify, analyze, and interpret trends or patterns in complex data sets
7. Filter and clean data by reviewing reports and performance indicators to locate and correct problems
8. Work with management to prioritize business and information needs
9. Locate and define new process improvement opportunities
2. Hands-on architecture of real time REST APIs or other solutions for streaming data from Graph using Spark
3. Interpret data, analyze results using statistical techniques and provide ongoing reports
4. Develop and implement databases, data collection systems, data analytics and other strategies that optimize statistical efficiency and quality
5. Acquire data from primary or secondary data sources and maintain databases/data systems
6. Identify, analyze, and interpret trends or patterns in complex data sets
7. Filter and clean data by reviewing reports and performance indicators to locate and correct problems
8. Work with management to prioritize business and information needs
9. Locate and define new process improvement opportunities