Logo
Booz Allen Hamilton

Databricks Data Engineer

Booz Allen Hamilton, Atlanta, Georgia, United States, 30383


Job Number: R0204928

Databricks Data Engineer

The Opportunity:As a Senior Data Engineer, you will be responsible for designing, building, and maintaining robust data pipelines within an organization. Your key tasks will include creating and optimizing end-to-end data flows, handling extract, transform, load (ETL) processes, designing data models, ensuring data security and compliance, collaborating with cross-functional teams, and continuously improving performance and scalability. Your expertise will bridge the gap between raw data and actionable insights, enabling efficient data processing and analytics across the business.As a big data engineer at Booz Allen, you'll implement data engineering activities on some of the most mission-driven projects in the industry. You'll deploy and develop pipelines and platforms that organize and make disparate data meaningful.Here, you'll work with and guide a multi-disciplinary team of analysts, data engineers, developers, and data consumers in a fast-paced, agile environment. You'll use your experience in analytical exploration and data examination while you manage the assessment, design, building, and maintenance of scalable platforms for your clients.Work with us to use big data for good. Join us. The world can't wait.You Have:8+ years of experience in designing and developing ETL processes and managing data pipelines3+ years of experience with Databricks, including building and optimizing data pipelines using Databricks notebooks and clustersExperience using Azure data services, including Azure Data Factory, Azure SQL service, Azure Blob Storage, and Azure Synapse AnalyticsExperience with Azure Data Catalog for managing metadata, schema definitions, and data lineageExperience monitoring ETL job runs, identifying bottlenecks, and troubleshooting issues, including use of Azure MonitorKnowledge of performance optimization techniques for ETL jobs, such as partitioning, bucketing, and cachingAbility to write Python code for ETL scripts and custom transformationsAbility to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirementsBachelor's degreeNice If You Have:Experience with creating and maintaining Data Factory pipelines preferredExperience with integrating machine learning models into data pipelinesExperience with stream processing frameworks, such as Apache Kafka, Azure Event Hub, and cloud-native compute services, such as Azure FunctionsExperience leveraging serverless architectures for data processingExperience ensuring data quality, privacy, and securityKnowledge of Databricks Delta Lake preferredKnowledge of data governance practices, data lineage, and compliance requirements, such as NISTKnowledge of tools, such as Apache Atlas, Azure Data Catalog, DVSum, or Collibra, for managing metadata, data lineage, and cataloging data assetsAbility to design and implement data models, define schemas, optimize data structures for efficient querying and analytics, and troubleshoot and improve query performanceVetting:Applicants selected will be subject to a government investigation and may need to meet eligibility requirements of the U.S. government client.Compensation:At Booz Allen, we celebrate your contributions, provide you with opportunities and choices, and support your total well-being. Our offerings include health, life, disability, financial, and retirement benefits, as well as paid leave, professional development, tuition assistance, work-life programs, and dependent care. Our recognition awards program acknowledges employees for exceptional performance and superior demonstration of our values.Salary at Booz Allen is determined by various factors, including but not limited to location, the individual's particular combination of education, knowledge, skills, competencies, and experience, as well as contract-specific affordability and organizational requirements. The projected compensation range for this position is $75,600.00 to $172,000.00 (annualized USD). The estimate displayed represents the typical salary range for this position and is just one component of Booz Allen's total compensation package for employees. This posting will close within 90 days from the Posting Date.Work Model:If this position is listed as remote or hybrid, you'll periodically work from a Booz Allen or client site facility.If this position is listed as onsite, you'll work with colleagues and clients in person, as needed for the specific role.EEO Commitment:We're an equal employment opportunity/affirmative action employer that empowers our people to fearlessly drive change - no matter their race, color, ethnicity, religion, sex (including pregnancy, childbirth, lactation, or related medical conditions), national origin, ancestry, age, marital status, sexual orientation, gender identity and expression, disability, veteran status, military or uniformed service member status, genetic information, or any other status protected by applicable federal, state, local, or international law.

#J-18808-Ljbffr