Technogen International Company
Data Engineer
Technogen International Company, Alpharetta, GA
Position: Data Engineer
Location: Alpharetta, GA
Working Model- Hybrid, at least one day a week in the office, and they will need to come in if there is a mandatory meeting. Local candidates only to Alpharetta GA
As a Data Engineer, you must have:
Description:
10+ years of experience in data engineering.
Design, develop, and maintain new data capabilities and infrastructure for utilizing Verizon, third-party, and partner data to enhance client's data products and solutions
Design, develop, and implement scalable data pipelines and ETL/ELT processes using SSIS, Python and API integrations
Identify existing data capability and infrastructure gaps or opportunities within and across initiatives and provide subject matter expertise in support of remediation
Collaborate with technical team and business stakeholders to understand data requirements and translate them into technical solutions
Work with large datasets, ensuring data quality, accuracy, and performance
Implement data transformation, integration, and validation processes to support analytics and reporting needs
Optimize and fine-tune data pipelines for improved speed, reliability, and efficiency
Implement best practices for data storage, retrieval, and archival to ensure data accessibility and security
Troubleshoot and resolve data-related issues, collaborating with the team to identify root causes
Document data processes, data lineage, and technical specifications for future reference
Review and analyze existing data collection systems, and make recommendations on improvement, maintenance, or other factors to improve the system.
Develop, build, and implement new data collection systems where needed.
Provide training and guidance on new systems that are being implemented.
Participate in code reviews, ensuring adherence to coding standards and best practices
Collaborate with other teams to automate deployment and monitoring of data pipelines
Proven experience in data engineering, with a strong track record of designing and implementing data solutions
Proficiency in programming languages such as Python, Java, or Scala, and experience with data processing frameworks (Spark, Hadoop, etc.)
In-depth understanding of data warehousing concepts, cloud platforms (Google Cloud Platform), and data modeling techniques
Strong knowledge of SQL and NoSQL databases, as well as data integration and transformation tools(SSIS)
Passion for and engagement with emerging trends in data, AI/ML, analytics, and digital experiences
Experience in data product development, analytical models, and model governance
Experience in anonymizing data and managing the use of data
Experience in data hygiene procedures, identity resolution capabilities or data management a plus
Familiarity with BI technologies (e.g. Microsoft Power BI, Tableau)
Ability to create strategies and plans that define how information can be utilized to support an organization's overall business strategy, and how that information and data is organized, and governed inside an organization
Familiarity with industry best practices for collection and use of data
Outstanding problem-solving skills and the ability to navigate complex data challenges
Proven abilities to take initiative and be innovative.
Analytical mind with a problem-solving aptitude
Effective communication and collaboration skills to work with both technical and non-technical stakeholders
MUST HAVE SKILLS:
Microsoft SQL Server
Microsoft Business Intelligence(SSIS,SSAS & SSRS)
Python
Google Cloud Platform Data Services
Tableau
Location: Alpharetta, GA
Working Model- Hybrid, at least one day a week in the office, and they will need to come in if there is a mandatory meeting. Local candidates only to Alpharetta GA
As a Data Engineer, you must have:
Description:
10+ years of experience in data engineering.
Design, develop, and maintain new data capabilities and infrastructure for utilizing Verizon, third-party, and partner data to enhance client's data products and solutions
Design, develop, and implement scalable data pipelines and ETL/ELT processes using SSIS, Python and API integrations
Identify existing data capability and infrastructure gaps or opportunities within and across initiatives and provide subject matter expertise in support of remediation
Collaborate with technical team and business stakeholders to understand data requirements and translate them into technical solutions
Work with large datasets, ensuring data quality, accuracy, and performance
Implement data transformation, integration, and validation processes to support analytics and reporting needs
Optimize and fine-tune data pipelines for improved speed, reliability, and efficiency
Implement best practices for data storage, retrieval, and archival to ensure data accessibility and security
Troubleshoot and resolve data-related issues, collaborating with the team to identify root causes
Document data processes, data lineage, and technical specifications for future reference
Review and analyze existing data collection systems, and make recommendations on improvement, maintenance, or other factors to improve the system.
Develop, build, and implement new data collection systems where needed.
Provide training and guidance on new systems that are being implemented.
Participate in code reviews, ensuring adherence to coding standards and best practices
Collaborate with other teams to automate deployment and monitoring of data pipelines
Proven experience in data engineering, with a strong track record of designing and implementing data solutions
Proficiency in programming languages such as Python, Java, or Scala, and experience with data processing frameworks (Spark, Hadoop, etc.)
In-depth understanding of data warehousing concepts, cloud platforms (Google Cloud Platform), and data modeling techniques
Strong knowledge of SQL and NoSQL databases, as well as data integration and transformation tools(SSIS)
Passion for and engagement with emerging trends in data, AI/ML, analytics, and digital experiences
Experience in data product development, analytical models, and model governance
Experience in anonymizing data and managing the use of data
Experience in data hygiene procedures, identity resolution capabilities or data management a plus
Familiarity with BI technologies (e.g. Microsoft Power BI, Tableau)
Ability to create strategies and plans that define how information can be utilized to support an organization's overall business strategy, and how that information and data is organized, and governed inside an organization
Familiarity with industry best practices for collection and use of data
Outstanding problem-solving skills and the ability to navigate complex data challenges
Proven abilities to take initiative and be innovative.
Analytical mind with a problem-solving aptitude
Effective communication and collaboration skills to work with both technical and non-technical stakeholders
MUST HAVE SKILLS:
Microsoft SQL Server
Microsoft Business Intelligence(SSIS,SSAS & SSRS)
Python
Google Cloud Platform Data Services
Tableau