Dice
Data Engineer
Dice, Manassas, Virginia, United States, 22110
Dice is the leading career destination for tech experts at every stage of their careers. Our client, Feuji Inc, is seeking the following. Apply via Dice today!
Job Description:
Duties and Responsibilities:
Create and maintain optimal data pipeline architecture,Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.Build data pipeline frameworks to automate high-volume and real-time data delivery to our cloud platform.Design and develop ETL solutions to move data from any source (relational, API, non-relational) to data warehouse/delta lakes.Have thorough knowledge of Data warehousing designs and have experience in designing conceptual and logical data models and flowcharts.Ability to write and maintain Spark and Python notebook in Azure for data integration and analysis.Apply modern cloud data modelling techniques to ensure development and implementation support efforts meet integration and performance expectations.Ability to Independently analyze data, solve, and correct issues in real time, providing problem resolution end-to-end.Coordinate with other IT teams and Client departments to identify future needs and requirements.Refine and automate regular processes, track issues, and document changes.Design, develop and maintain data services and/or pipelines as part of an Agile/Scrum team.Work with program management and engineers to implement and document complex and evolving requirements.Assist developers with complex query tuning and schema refinement.Share domain and technical expertise, providing technical mentorship and cross-training to other peers and team members.Perform multiple tasks simultaneously and successfully perform under changing requirements and deadlines.
Minimum Qualifications and Requirements:
Bachelor's degree or equivalent experience and a minimum of eight (8) years experience in designing and developing data integration solutions.Expertise in SQL and Data warehousing concepts. Experience with modern cloud databases and services in Azure environment. This should include working with Azure synapse environment and also have knowledge of NoSQL databases specially Cosmos.Experience in designing and implementing ETL in Azure data integration tools (Azure data factory, Azure synapse pipelines, Spark notebooks).Experience in working on Delta Lake in Azure of data bricks environment and worked in implementing delta lake earlier.Knowledge to manage huge amounts on unstructured data from devices.Experience with Performance Tuning and Optimization (PTO), using native monitoring and troubleshooting tools.Leverage DevOps tool stack to build, inspect, deploy, test and promote new or updated features.Experience with reporting (e.g. SSRS, Business Objects, Cognos etc.) and data visualization tools (e.g. Power BI, Tableau)Self-starter, motivated and takes initiative; strong interpersonal and problem-solving skills; able to work collaboratively with all levels of staff to resolve problems to maximize performance, creativity, problem solving and results.Seek, learn, and apply new skills/knowledge to perform job responsibilities.Attentive to detail with a high level of accuracy; exercise sound judgment.Resourceful, diplomatic, and professional; deliver outstanding customer service while managing relationships; a can-do attitude and work style that supports teamwork, collaboration and positive relationships.Adaptable; be able to shift priorities and focus as departmental and/or business demands change (including, but not limited to early/late hours and/or weekend hours).Strong analytical skills and organized; completes tasks ahead of schedule.Excellent written and verbal communication skills, including excellent listening skills to communicate clearly, concisely and effectively.Position-relevant computer experience including Microsoft Office.Follow all company safety practices, Standard Operating Procedures (SOP s) and policies.
Data Engineer#J-18808-Ljbffr
Job Description:
Duties and Responsibilities:
Create and maintain optimal data pipeline architecture,Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.Build data pipeline frameworks to automate high-volume and real-time data delivery to our cloud platform.Design and develop ETL solutions to move data from any source (relational, API, non-relational) to data warehouse/delta lakes.Have thorough knowledge of Data warehousing designs and have experience in designing conceptual and logical data models and flowcharts.Ability to write and maintain Spark and Python notebook in Azure for data integration and analysis.Apply modern cloud data modelling techniques to ensure development and implementation support efforts meet integration and performance expectations.Ability to Independently analyze data, solve, and correct issues in real time, providing problem resolution end-to-end.Coordinate with other IT teams and Client departments to identify future needs and requirements.Refine and automate regular processes, track issues, and document changes.Design, develop and maintain data services and/or pipelines as part of an Agile/Scrum team.Work with program management and engineers to implement and document complex and evolving requirements.Assist developers with complex query tuning and schema refinement.Share domain and technical expertise, providing technical mentorship and cross-training to other peers and team members.Perform multiple tasks simultaneously and successfully perform under changing requirements and deadlines.
Minimum Qualifications and Requirements:
Bachelor's degree or equivalent experience and a minimum of eight (8) years experience in designing and developing data integration solutions.Expertise in SQL and Data warehousing concepts. Experience with modern cloud databases and services in Azure environment. This should include working with Azure synapse environment and also have knowledge of NoSQL databases specially Cosmos.Experience in designing and implementing ETL in Azure data integration tools (Azure data factory, Azure synapse pipelines, Spark notebooks).Experience in working on Delta Lake in Azure of data bricks environment and worked in implementing delta lake earlier.Knowledge to manage huge amounts on unstructured data from devices.Experience with Performance Tuning and Optimization (PTO), using native monitoring and troubleshooting tools.Leverage DevOps tool stack to build, inspect, deploy, test and promote new or updated features.Experience with reporting (e.g. SSRS, Business Objects, Cognos etc.) and data visualization tools (e.g. Power BI, Tableau)Self-starter, motivated and takes initiative; strong interpersonal and problem-solving skills; able to work collaboratively with all levels of staff to resolve problems to maximize performance, creativity, problem solving and results.Seek, learn, and apply new skills/knowledge to perform job responsibilities.Attentive to detail with a high level of accuracy; exercise sound judgment.Resourceful, diplomatic, and professional; deliver outstanding customer service while managing relationships; a can-do attitude and work style that supports teamwork, collaboration and positive relationships.Adaptable; be able to shift priorities and focus as departmental and/or business demands change (including, but not limited to early/late hours and/or weekend hours).Strong analytical skills and organized; completes tasks ahead of schedule.Excellent written and verbal communication skills, including excellent listening skills to communicate clearly, concisely and effectively.Position-relevant computer experience including Microsoft Office.Follow all company safety practices, Standard Operating Procedures (SOP s) and policies.
Data Engineer#J-18808-Ljbffr