ICF Olson
Senior Data Engineer (USA/Remote)
ICF Olson, Reston, Virginia, United States, 22090
Senior Data Engineer (USA/Remote)
ICF is a mission-driven company filled with people who care deeply about improving the lives of others and making the world a better place. Our core values include Embracing Difference; we seek candidates who are passionate about building a culture that encourages, embraces, and hires dimensions of difference.Our Health Engineering Systems (HES) team works side by side with customers to articulate a vision for success, and then make it happen. We know success doesn't happen by accident. It takes the right team of people, working together on the right solutions for the customer. We are looking for a seasoned Senior Data Engineer who will be a key driver to make this happen.Responsibilities:Design, develop, and maintain scalable data pipelines using Spark, Hive, and Airflow.Develop and deploy data processing workflows on the Databricks platform.Develop API services to facilitate data access and integration.Create interactive data visualizations and reports using AWS QuickSight.Build required infrastructure for optimal extraction, transformation, and loading of data from various data sources using AWS and SQL technologies.Monitor and optimize the performance of data infrastructure and processes.Develop data quality and validation jobs.Assemble large, complex sets of data that meet non-functional and functional business requirements.Write unit and integration tests for all data processing code.Work with DevOps engineers on CI, CD, and IaC.Read specs and translate them into code and design documents.Perform code reviews and develop processes for improving code quality.Improve data availability and timeliness by implementing more frequent refreshes, tiered data storage, and optimizations of existing datasets.Maintain security and privacy for data at rest and while in transit.Other duties as assigned.Minimum Qualifications:Bachelor's degree in computer science, engineering, or related field or comparable experience.5+ years of hands-on software or data development experience (3 years with Masters).4+ years of data pipeline experience using Python, Java, and cloud technologies.Candidate must be able to obtain and maintain a Public Trust clearance.Candidate must reside in the US, be authorized to work in the US, and work must be performed in the US.Must have lived in the US 3 full years out of the last 5 years.Preferred Qualifications:Experienced in Spark and Hive for big data processing.Experience building job workflows with the Databricks platform.Strong understanding of AWS products including S3, Redshift, RDS, EMR, AWS Glue, AWS Glue DataBrew, Jupyter Notebooks, Athena, QuickSight, EMR, and Amazon SNS.Familiar with work to build processes that support data transformation, workload management, data structures, dependency, and metadata.Experienced in data governance processes to ingest (batch, stream), curate, and share data with upstream and downstream data users.Experienced in data pipeline building and data wrangling who enjoys optimizing data systems and building them from the ground up.Demonstrated understanding using software and tools including relational NoSQL and SQL databases including Cassandra and Postgres; workflow management and pipeline tools such as Airflow, Luigi, and Azkaban; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, C++, Java, and Python.Familiar with DevOps methodologies, including CI/CD pipelines (Github Actions) and IaC (Terraform).Ability to obtain and maintain a Public Trust; residing in the United States.Experience with Agile methodology, using test-driven development.Job Location:
This position requires that the job be performed in the United States. If you accept this position, you should note that ICF does monitor employee work locations and blocks access from foreign locations/foreign IP addresses, and also prohibits personal VPN connections.Working at ICF:
ICF is a global advisory and technology services provider, but we’re not your typical consultants. We combine unmatched expertise with cutting-edge technology to help clients solve their most complex challenges, navigate change, and shape the future.ICF is an equal opportunity employer, committed to hiring regardless of any protected characteristic, such as race, ethnicity, national origin, color, sex, gender identity/expression, sexual orientation, religion, age, disability status, or military/veteran status.Pay Range:
The pay range for this position based on full-time employment is: $87,069.00 - $148,017.00 Virginia Remote Office (VA99).
#J-18808-Ljbffr
ICF is a mission-driven company filled with people who care deeply about improving the lives of others and making the world a better place. Our core values include Embracing Difference; we seek candidates who are passionate about building a culture that encourages, embraces, and hires dimensions of difference.Our Health Engineering Systems (HES) team works side by side with customers to articulate a vision for success, and then make it happen. We know success doesn't happen by accident. It takes the right team of people, working together on the right solutions for the customer. We are looking for a seasoned Senior Data Engineer who will be a key driver to make this happen.Responsibilities:Design, develop, and maintain scalable data pipelines using Spark, Hive, and Airflow.Develop and deploy data processing workflows on the Databricks platform.Develop API services to facilitate data access and integration.Create interactive data visualizations and reports using AWS QuickSight.Build required infrastructure for optimal extraction, transformation, and loading of data from various data sources using AWS and SQL technologies.Monitor and optimize the performance of data infrastructure and processes.Develop data quality and validation jobs.Assemble large, complex sets of data that meet non-functional and functional business requirements.Write unit and integration tests for all data processing code.Work with DevOps engineers on CI, CD, and IaC.Read specs and translate them into code and design documents.Perform code reviews and develop processes for improving code quality.Improve data availability and timeliness by implementing more frequent refreshes, tiered data storage, and optimizations of existing datasets.Maintain security and privacy for data at rest and while in transit.Other duties as assigned.Minimum Qualifications:Bachelor's degree in computer science, engineering, or related field or comparable experience.5+ years of hands-on software or data development experience (3 years with Masters).4+ years of data pipeline experience using Python, Java, and cloud technologies.Candidate must be able to obtain and maintain a Public Trust clearance.Candidate must reside in the US, be authorized to work in the US, and work must be performed in the US.Must have lived in the US 3 full years out of the last 5 years.Preferred Qualifications:Experienced in Spark and Hive for big data processing.Experience building job workflows with the Databricks platform.Strong understanding of AWS products including S3, Redshift, RDS, EMR, AWS Glue, AWS Glue DataBrew, Jupyter Notebooks, Athena, QuickSight, EMR, and Amazon SNS.Familiar with work to build processes that support data transformation, workload management, data structures, dependency, and metadata.Experienced in data governance processes to ingest (batch, stream), curate, and share data with upstream and downstream data users.Experienced in data pipeline building and data wrangling who enjoys optimizing data systems and building them from the ground up.Demonstrated understanding using software and tools including relational NoSQL and SQL databases including Cassandra and Postgres; workflow management and pipeline tools such as Airflow, Luigi, and Azkaban; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, C++, Java, and Python.Familiar with DevOps methodologies, including CI/CD pipelines (Github Actions) and IaC (Terraform).Ability to obtain and maintain a Public Trust; residing in the United States.Experience with Agile methodology, using test-driven development.Job Location:
This position requires that the job be performed in the United States. If you accept this position, you should note that ICF does monitor employee work locations and blocks access from foreign locations/foreign IP addresses, and also prohibits personal VPN connections.Working at ICF:
ICF is a global advisory and technology services provider, but we’re not your typical consultants. We combine unmatched expertise with cutting-edge technology to help clients solve their most complex challenges, navigate change, and shape the future.ICF is an equal opportunity employer, committed to hiring regardless of any protected characteristic, such as race, ethnicity, national origin, color, sex, gender identity/expression, sexual orientation, religion, age, disability status, or military/veteran status.Pay Range:
The pay range for this position based on full-time employment is: $87,069.00 - $148,017.00 Virginia Remote Office (VA99).
#J-18808-Ljbffr