Drawbridge
Software Developer ETL
Drawbridge, Chantilly, Virginia, United States, 22021
Our client is looking for a talented Software Developer with expertise in Big Data and ETL (Extract, Transform, Load) processes. The successful candidate will support data ingest, ETL development, data mapping, analytical and operational support, data quality assurance, and the maintenance of complex systems. This role requires strong experience with big data technologies, programming languages, and data management practices.Key Responsibilities:Data Ingestion & ETL Development:
Support the development of data ingestion processes and ETL pipelines to efficiently transform and load data from diverse structured data formats into enriched, query-friendly structured data.Data Mapping & Transformation:
Perform data mapping and transformation activities, ensuring data is properly structured and indexed for easy querying and analysis.Data Quality Assurance:
Conduct thorough data quality analysis to ensure accuracy, consistency, and reliability of data across systems.Information Gathering:
Collaborate with cross-functional teams to gather requirements and identify data sources, ensuring the successful integration of data into target systems.SQL & Stored Procedures:
Utilize SQL and stored procedure languages like PL/SQL to develop and optimize database queries and manage complex data operations.Regular Expressions:
Apply expertise in Regular Expressions (Rage) for data parsing, extraction, and transformation tasks.ETL Design Documentation:
Develop comprehensive ETL design documentation, including source and target mappings, data dictionary information, and process flow diagrams.Linux System Management:
Work with Linux operating systems to manage data processing environments and ensure seamless operation of ETL processes.Programming:
Develop scripts and applications using languages such as Bash, Python, and Scala to automate data processing and ETL tasks.AWS & Cloud Technologies:
Leverage AWS services such as S3 and DynamoDB for scalable storage, data retrieval, and ETL operations.Foreign Language Data Processing:
Work with data in foreign language (non-English) scripts such as Unicode, ensuring proper handling and transformation of multilingual data sets.Qualifications:Big Data Technologies:
Strong experience with big data technologies, particularly Python, Lambda, and PYSPARK.ETL Processes:
Demonstrated experience in developing and managing ETL processes, including data extraction, transformation, and loading from disparate sources.Data Quality:
Proven ability to perform data quality analysis, ensuring data integrity across systems.SQL & PL/SQL:
Proficiency in SQL and stored procedure languages such as PL/SQL for data management and query optimization.Linux & Scripting:
Experience with Linux operating systems and programming languages such as Bash, Python, and Scala.AWS Services:
Hands-on experience with AWS services, particularly S3 and DynamoDB, for cloud-based data storage and processing.Regular Expressions:
Expertise in using Regular Expressions (Rage) for data extraction and manipulation.Foreign Language Data:
Experience working with data in foreign language scripts (Unicode), ensuring accurate processing and transformation.Additional Requirements:Documentation Skills:
Ability to create detailed ETL design documentation, including source/target mappings and data dictionaries.Collaborative Skills:
Strong ability to gather information, collaborate with teams, and communicate effectively across technical and non-technical stakeholders.
Support the development of data ingestion processes and ETL pipelines to efficiently transform and load data from diverse structured data formats into enriched, query-friendly structured data.Data Mapping & Transformation:
Perform data mapping and transformation activities, ensuring data is properly structured and indexed for easy querying and analysis.Data Quality Assurance:
Conduct thorough data quality analysis to ensure accuracy, consistency, and reliability of data across systems.Information Gathering:
Collaborate with cross-functional teams to gather requirements and identify data sources, ensuring the successful integration of data into target systems.SQL & Stored Procedures:
Utilize SQL and stored procedure languages like PL/SQL to develop and optimize database queries and manage complex data operations.Regular Expressions:
Apply expertise in Regular Expressions (Rage) for data parsing, extraction, and transformation tasks.ETL Design Documentation:
Develop comprehensive ETL design documentation, including source and target mappings, data dictionary information, and process flow diagrams.Linux System Management:
Work with Linux operating systems to manage data processing environments and ensure seamless operation of ETL processes.Programming:
Develop scripts and applications using languages such as Bash, Python, and Scala to automate data processing and ETL tasks.AWS & Cloud Technologies:
Leverage AWS services such as S3 and DynamoDB for scalable storage, data retrieval, and ETL operations.Foreign Language Data Processing:
Work with data in foreign language (non-English) scripts such as Unicode, ensuring proper handling and transformation of multilingual data sets.Qualifications:Big Data Technologies:
Strong experience with big data technologies, particularly Python, Lambda, and PYSPARK.ETL Processes:
Demonstrated experience in developing and managing ETL processes, including data extraction, transformation, and loading from disparate sources.Data Quality:
Proven ability to perform data quality analysis, ensuring data integrity across systems.SQL & PL/SQL:
Proficiency in SQL and stored procedure languages such as PL/SQL for data management and query optimization.Linux & Scripting:
Experience with Linux operating systems and programming languages such as Bash, Python, and Scala.AWS Services:
Hands-on experience with AWS services, particularly S3 and DynamoDB, for cloud-based data storage and processing.Regular Expressions:
Expertise in using Regular Expressions (Rage) for data extraction and manipulation.Foreign Language Data:
Experience working with data in foreign language scripts (Unicode), ensuring accurate processing and transformation.Additional Requirements:Documentation Skills:
Ability to create detailed ETL design documentation, including source/target mappings and data dictionaries.Collaborative Skills:
Strong ability to gather information, collaborate with teams, and communicate effectively across technical and non-technical stakeholders.