Role: ETL Lead
Location: Atlanta, GA, USA(Onsite)
Job Type: Full Time
Must Have Technical/Functional Skills:
Informatica IICS, Orace, Databricks, SQL, Python, Databricks.
Experience Required:
10 Plus years of experience in the analysis, design, development, testing and maintenance of ETL/ELT solutions o Strong experience in the areas of Data Integration, Data Warehousing, application integration and Business Intelligence as an SME/Architect, showcasing deep knowledge of the platform's capabilities o Knowledge of Informatica products: Intelligent Data Management Cloud or (IICS), Informatica Power Center (10.4), Data Quality, Power Exchange and MDM. o Knowledge of connecting IICS to popular cloud platforms like Azure o Design end-to-end ETL processes using Python to extract,transform, and load data from diverse sources into a centralized data warehouse.
Worked on join, filter, aggregator, router, sorter, sequence generator, hierarchy-parser, expression transformations in informatica cloud IICS- Data Integration. o Experience working with Informatica IICS tool effectively using it for Data Migration from multiple source systems o Demonstrated success in building Restful API Integration, SOAP (WSDL) using IICS. o Develop modular and scalable ETL workflows, ensuring efficient data processing and seamless integration with downstream applications. o Integrate Data bricks with data lakes and data warehouses like AWS S3, Azure Data Lake Storage. o Strong knowledge in Data warehousing concepts, Relational Database Management Systems and Dimensional modeling. o Experience with database systems like SQL Server, Oracle, MySQL, and Mongo DB. o Implement Azure Data bricks cluster, notebooks, jobs and auto scaling. o Prepare Technical Design documents, Run books after completion of development. o Knowledge on Python Scripting. o Good working experience in Agile and Waterfall methodologies.
Roles & Responsibilities:
Lead the overall Data ingestion, ETL process. o Quickly adapt to standard policies/procedures processes and business needs. o Provide oversight and solutions to address gaps in application functionality, data quality, and performance related issues and executing/revising/Updating, and SQL code to respond to different maintenance requests. o Lead the automation effort by developing scripts in Unix and or Python o Handle performance challenges and incorporate best practice to improve efficiency.