ICONMA
Hadoop & ETL Developer
ICONMA, Charlotte, North Carolina, United States, 28245
Location: Charlotte, NC/ Atlanta, GA/ Chandler, AZDuration: 12 months
Description:As a Hadoop & ETL Developer to support production (L3) in Treasury ADS, individual will be responsible for understanding design, propose high level and detailed design solutions, propose out of box technical solutions for resolving business problems and technical problems arise during the real time in production. Individual should be flexible to work on the weekends at least once in a month. May get comp-off during weekdays. As an individual contributor in Client, person should have good analytical skills to take a quick decision during the tough times. Engage in discussions with information architecture team for coming out with design solutions, proposing new technology adoption ideas, attending project meetings, partnering with near shore and offshore teammates in a matrix environment, coordinating with other support teams like L2, development, testing, upstream and downstream partners, etc.Client support activities like analysis, coding, propose improvement ideas, drive the development activities at offshore.Able to think over in a quick turnaround time to address the situation in production.Work on multiple projects concurrently, take ownership & pride in the work done by them, attending project meetings, understanding requirements, designing solutions, developing codePartnering with near shore and offshore teammates in a matrix environment, coordinating with other support teams like L2, development, testing, up/down stream partners, etc.Work with Information Architecture team for proposing technical solutions to business problemsIdentify gaps in technology and propose viable solutionsTake accountability of the technical deliveries from offshoreUnderstand Hadoop, Spark, Python and other Eco Systems like Impala, Hive, Oozie, Pig etc., Autosys and UNIX Shell Scripting.Work with the development teams and QA during the post code development phaseIdentify improvement areas within the application and work with the respective teams to implement the sameEnsuring adherence to defined process & quality standards, best practices, high quality levels in all deliverablesAdhere to team's governing principles and policies
Required Skills
Strong working knowledge of ETL, database technologies, big data and data processing skills3+ years of experience developing ETL solutions using any ETL tool like Informatica, SSIS, etc.3+ years of experience developing applications using Hadoop, Spark, Impala, Hive & Python.3+ years of experience in running, using and troubleshooting the ETL & Cloudera Hadoop Ecosystem i. e. Hadoop FS, Hive, Impala, Spark, Kafka, Hue, Oozie, Yarn, Sqoop, Flume.Experience on Autosys JIL scripting.Proficient scripting skills i.e. Unix shell & Perl ScriptingExperience troubleshooting data-related issues.Experience processing large amounts of structured and unstructured data with MapReduce.Experience in SQL and Relation Database developing data extraction applications.Experience with data movement and transformation technologies.Good to have experience in Python / Scala programming
As an equal opportunity employer, ICONMA provides an employment environment that supports and encourages the abilities of all persons without regard to race, color, religion, gender, sexual orientation, gender identity or express, ethnicity, national origin, age, disability status, political affiliation, genetics, marital status, protected veteran status, or any other characteristic protected by federal, state, or local laws.
Description:As a Hadoop & ETL Developer to support production (L3) in Treasury ADS, individual will be responsible for understanding design, propose high level and detailed design solutions, propose out of box technical solutions for resolving business problems and technical problems arise during the real time in production. Individual should be flexible to work on the weekends at least once in a month. May get comp-off during weekdays. As an individual contributor in Client, person should have good analytical skills to take a quick decision during the tough times. Engage in discussions with information architecture team for coming out with design solutions, proposing new technology adoption ideas, attending project meetings, partnering with near shore and offshore teammates in a matrix environment, coordinating with other support teams like L2, development, testing, upstream and downstream partners, etc.Client support activities like analysis, coding, propose improvement ideas, drive the development activities at offshore.Able to think over in a quick turnaround time to address the situation in production.Work on multiple projects concurrently, take ownership & pride in the work done by them, attending project meetings, understanding requirements, designing solutions, developing codePartnering with near shore and offshore teammates in a matrix environment, coordinating with other support teams like L2, development, testing, up/down stream partners, etc.Work with Information Architecture team for proposing technical solutions to business problemsIdentify gaps in technology and propose viable solutionsTake accountability of the technical deliveries from offshoreUnderstand Hadoop, Spark, Python and other Eco Systems like Impala, Hive, Oozie, Pig etc., Autosys and UNIX Shell Scripting.Work with the development teams and QA during the post code development phaseIdentify improvement areas within the application and work with the respective teams to implement the sameEnsuring adherence to defined process & quality standards, best practices, high quality levels in all deliverablesAdhere to team's governing principles and policies
Required Skills
Strong working knowledge of ETL, database technologies, big data and data processing skills3+ years of experience developing ETL solutions using any ETL tool like Informatica, SSIS, etc.3+ years of experience developing applications using Hadoop, Spark, Impala, Hive & Python.3+ years of experience in running, using and troubleshooting the ETL & Cloudera Hadoop Ecosystem i. e. Hadoop FS, Hive, Impala, Spark, Kafka, Hue, Oozie, Yarn, Sqoop, Flume.Experience on Autosys JIL scripting.Proficient scripting skills i.e. Unix shell & Perl ScriptingExperience troubleshooting data-related issues.Experience processing large amounts of structured and unstructured data with MapReduce.Experience in SQL and Relation Database developing data extraction applications.Experience with data movement and transformation technologies.Good to have experience in Python / Scala programming
As an equal opportunity employer, ICONMA provides an employment environment that supports and encourages the abilities of all persons without regard to race, color, religion, gender, sexual orientation, gender identity or express, ethnicity, national origin, age, disability status, political affiliation, genetics, marital status, protected veteran status, or any other characteristic protected by federal, state, or local laws.