Intelligent Waves
SFIS Compliance Data Engineer
Intelligent Waves, Arlington, Virginia, United States, 22201
Overview:
Since 2006, Intelligent Waves has delivered mission-focused multi-domain operational expertise and innovation to the Government through high-impact technology solutions in cybersecurity, data science, enterprise network engineering, software development, and platform mission support. Anytime. Anywhere. Any domain.Advana is a multi-domain technology platform which offers military and business decision makers, analysts, and users at all levels unprecedented access to authoritative enterprise data and structured analytics in a scalable, reliable, and secure environment. It offers platform-, data analytics-, and data science-as-a-service tools to complete analysis and data exploration and data visualization capabilities. Using one central data platform with right-time data, data tools, and other self-service products, the goal of Advana is to simplify solutions and put the power of analytics in the pocket of every analyst and decision-making authority within the DOD.Location & Travel:
The Data Engineer position will be a Hybrid role based in Crystal City VA, Alexandria VA, or the Pentagon. The candidate will need to be able to go on-site on an as needed basis to one of these sites.
Security Clearance:
The Data Engineer must be a United States Citizen and hold a current DoD Secret security clearance.Mission - ADVANA
Employees are required to follow all company and customer site COVID-19 protocols.Responsibilities:This Data Engineer will work on the MISFITS SFIS Compliance team as the primary owner of the app's codebase in Databricks. The MISFITS SFIS Compliance tool is being transitioned to EFT in August and this role is being added to absorb the DE work previously done by another team. The code base that supports the application is substantial, so the ideal candiate will have about 5 years of true experience.Responsibilities:Design, develop, and implement end-to-end data pipelines, utilizing ETL processes and technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.Create and optimize data pipelines from scratch, ensuring scalability, reliability, and high-performance processing.Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets.Leverage big data technologies to efficiently process and analyze large datasets, particularly those encountered in a federal agency.Troubleshoot data-related problems and provide innovative solutions to address complex data challenges.Implement and enforce data governance policies and procedures, ensuring compliance with regulatory requirements and industry best practices.Work closely with cross-functional teams to understand data requirements and design optimal data models and architectures.Collaborate with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support decision-making processes.Maintain documentation for software applications, workflows, and processes.Stay updated with emerging trends and advancements in data engineering and recommend suitable tools and technologies for continuous improvement.Qualifications:
Around 5 years of experience as a Data Engineer, with demonstrated experience creating data pipelines from scratch.High level of proficiency in ETL processes and demonstrated, hands-on experience with technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.Strong problem-solving skills and ability to solve complex data-related issues.Demonstrated experience working with large datasets and leveraging big data technologies to process and analyze data efficiently.Understanding of data modeling/visualization, database design principles, and data governance practices.Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams.Detail-oriented mindset with a commitment to delivering high-quality results.Clearance Statement:
Applicants selected for this position will be subject to a government security investigation and must meet eligibility requirements for access to classified information. Only US citizens are eligible for a security clearance. For this position, Intelligent Waves will consider only applicants with security clearances or applicants who are eligible for security clearances.Intelligent Waves LLC is an equal opportunity employer. We are committed to providing equal opportunity to all applicants and employees in full compliance with all applicable state and federal laws prohibiting discrimination on the basis of race, color, age, gender, religion, national origin, disability, sexual orientation and gender identity protected veteran status and individuals with disabilities, or any other class protected by applicable state or federal law.As an Affirmative Action and Equal Opportunity Employer, IW is committed to the full inclusion of all qualified candidates and current employees. As part of this commitment, IW will ensure that those in need are provided reasonable accommodations. If reasonable accommodation is needed to participate in the job application or interview process, to perform essential job functions, and/or to receive other benefits and privileges of employment, please contact humanresources@intelligentwaves.com.
A Veteran Friendly Organization#IW
Since 2006, Intelligent Waves has delivered mission-focused multi-domain operational expertise and innovation to the Government through high-impact technology solutions in cybersecurity, data science, enterprise network engineering, software development, and platform mission support. Anytime. Anywhere. Any domain.Advana is a multi-domain technology platform which offers military and business decision makers, analysts, and users at all levels unprecedented access to authoritative enterprise data and structured analytics in a scalable, reliable, and secure environment. It offers platform-, data analytics-, and data science-as-a-service tools to complete analysis and data exploration and data visualization capabilities. Using one central data platform with right-time data, data tools, and other self-service products, the goal of Advana is to simplify solutions and put the power of analytics in the pocket of every analyst and decision-making authority within the DOD.Location & Travel:
The Data Engineer position will be a Hybrid role based in Crystal City VA, Alexandria VA, or the Pentagon. The candidate will need to be able to go on-site on an as needed basis to one of these sites.
Security Clearance:
The Data Engineer must be a United States Citizen and hold a current DoD Secret security clearance.Mission - ADVANA
Employees are required to follow all company and customer site COVID-19 protocols.Responsibilities:This Data Engineer will work on the MISFITS SFIS Compliance team as the primary owner of the app's codebase in Databricks. The MISFITS SFIS Compliance tool is being transitioned to EFT in August and this role is being added to absorb the DE work previously done by another team. The code base that supports the application is substantial, so the ideal candiate will have about 5 years of true experience.Responsibilities:Design, develop, and implement end-to-end data pipelines, utilizing ETL processes and technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.Create and optimize data pipelines from scratch, ensuring scalability, reliability, and high-performance processing.Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets.Leverage big data technologies to efficiently process and analyze large datasets, particularly those encountered in a federal agency.Troubleshoot data-related problems and provide innovative solutions to address complex data challenges.Implement and enforce data governance policies and procedures, ensuring compliance with regulatory requirements and industry best practices.Work closely with cross-functional teams to understand data requirements and design optimal data models and architectures.Collaborate with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support decision-making processes.Maintain documentation for software applications, workflows, and processes.Stay updated with emerging trends and advancements in data engineering and recommend suitable tools and technologies for continuous improvement.Qualifications:
Around 5 years of experience as a Data Engineer, with demonstrated experience creating data pipelines from scratch.High level of proficiency in ETL processes and demonstrated, hands-on experience with technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.Strong problem-solving skills and ability to solve complex data-related issues.Demonstrated experience working with large datasets and leveraging big data technologies to process and analyze data efficiently.Understanding of data modeling/visualization, database design principles, and data governance practices.Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams.Detail-oriented mindset with a commitment to delivering high-quality results.Clearance Statement:
Applicants selected for this position will be subject to a government security investigation and must meet eligibility requirements for access to classified information. Only US citizens are eligible for a security clearance. For this position, Intelligent Waves will consider only applicants with security clearances or applicants who are eligible for security clearances.Intelligent Waves LLC is an equal opportunity employer. We are committed to providing equal opportunity to all applicants and employees in full compliance with all applicable state and federal laws prohibiting discrimination on the basis of race, color, age, gender, religion, national origin, disability, sexual orientation and gender identity protected veteran status and individuals with disabilities, or any other class protected by applicable state or federal law.As an Affirmative Action and Equal Opportunity Employer, IW is committed to the full inclusion of all qualified candidates and current employees. As part of this commitment, IW will ensure that those in need are provided reasonable accommodations. If reasonable accommodation is needed to participate in the job application or interview process, to perform essential job functions, and/or to receive other benefits and privileges of employment, please contact humanresources@intelligentwaves.com.
A Veteran Friendly Organization#IW