Atlas Tech
Data Engineer
Atlas Tech, Alexandria, Virginia, us, 22350
We are seeking a skilled and experienced Data Engineer to join our team. The ideal candidate will be responsible for designing, implementing, and maintaining ETL processes for both structured and unstructured data. Experience with Microsoft Dynamics 365 and the Dataverse is highly desirable, as well as proficiency in Python scripting. The successful candidate will play a crucial role in ensuring the efficient and secure handling of data, contributing to the optimization of our data infrastructure.
Pay Range: $120,000 - $165,000
Travel Up To - 20%
You Will:
Design, develop, and maintain ETL processes for structured and unstructured data.Integrate data from various sources into our data infrastructure.Optimize and tune ETL processes for performance and reliability.Collaborate with data analysts, data scientists, and other stakeholders to understand data requirements and provide robust solutions.Implement data validation and quality checks to ensure data accuracy and integrity.Develop and maintain documentation for ETL processes and data workflows.Monitor ETL jobs and data pipelines, addressing issues promptly.Ensure data security and compliance with relevant regulations.Work with Microsoft Dynamics 365 and Dataverse to integrate and manage data.Utilize Python scripting for data manipulation, automation, and integration tasks.Stay up-to-date with emerging technologies and best practices in data engineering.Support data migration projects and contribute to cloud data integration initiatives.You Have:
Bachelor’s degree in Computer Science, Information Technology, or a related field.Proven experience as a Data Engineer or in a similar role.Experience with Microsoft Azure Data Factory, Data Lake Storage Gen2, Azure Blob Storage.Experience migrating data from Microsoft SQL Server Databases into Microsoft Dataverse.Experience with Cloud Platforms (Microsoft Azure Gov Cloud or Amazon Web Service Gov Cloud).Experience migrating multiple data formats from and to Microsoft SharePoint Online.Experience in Oracle Web Logic Server.Expertise in ETL processes for both structured and unstructured data.Experience with Microsoft Dynamics 365 Customer Service and Dataverse.Proficiency in Python scripting.Strong understanding of data architecture, data modeling, and database design principles.Familiarity with SQL and noSQL databases.Experience with data integration tools and platforms.Knowledge of data security and privacy best practices.Excellent problem-solving and analytical skills.Effective communication and collaboration skills.Ability to work independently and as part of a team.This position offers a unique opportunity to contribute to the optimization and security of our data infrastructure. If you are passionate about data engineering and have the required skills and experience, we encourage you to apply.
#J-18808-Ljbffr
Pay Range: $120,000 - $165,000
Travel Up To - 20%
You Will:
Design, develop, and maintain ETL processes for structured and unstructured data.Integrate data from various sources into our data infrastructure.Optimize and tune ETL processes for performance and reliability.Collaborate with data analysts, data scientists, and other stakeholders to understand data requirements and provide robust solutions.Implement data validation and quality checks to ensure data accuracy and integrity.Develop and maintain documentation for ETL processes and data workflows.Monitor ETL jobs and data pipelines, addressing issues promptly.Ensure data security and compliance with relevant regulations.Work with Microsoft Dynamics 365 and Dataverse to integrate and manage data.Utilize Python scripting for data manipulation, automation, and integration tasks.Stay up-to-date with emerging technologies and best practices in data engineering.Support data migration projects and contribute to cloud data integration initiatives.You Have:
Bachelor’s degree in Computer Science, Information Technology, or a related field.Proven experience as a Data Engineer or in a similar role.Experience with Microsoft Azure Data Factory, Data Lake Storage Gen2, Azure Blob Storage.Experience migrating data from Microsoft SQL Server Databases into Microsoft Dataverse.Experience with Cloud Platforms (Microsoft Azure Gov Cloud or Amazon Web Service Gov Cloud).Experience migrating multiple data formats from and to Microsoft SharePoint Online.Experience in Oracle Web Logic Server.Expertise in ETL processes for both structured and unstructured data.Experience with Microsoft Dynamics 365 Customer Service and Dataverse.Proficiency in Python scripting.Strong understanding of data architecture, data modeling, and database design principles.Familiarity with SQL and noSQL databases.Experience with data integration tools and platforms.Knowledge of data security and privacy best practices.Excellent problem-solving and analytical skills.Effective communication and collaboration skills.Ability to work independently and as part of a team.This position offers a unique opportunity to contribute to the optimization and security of our data infrastructure. If you are passionate about data engineering and have the required skills and experience, we encourage you to apply.
#J-18808-Ljbffr