Sr. Data Engineer

Bitsight is a cyber risk management leader transforming how companies manage exposure, performance, and risk for themselves and their third parties. Companies rely on Bitsight to prioritize their cybersecurity investments, build greater trust within their ecosystem, and reduce their chances of financial loss.Built on over a decade of technological innovation, its integrated solutions deliver value across enterprise security performance, digital supply chains, cyber insurance, and data analysis.We invented the cyber ratings industry in 2011Over 3000 customers trust BitsightOver 750 teammates are dispersed throughout Boston, Raleigh, New York, Lisbon, Singapore, and remote We are looking for a seasoned and talented Senior Data Engineer, who is well-versed in collaborating with cross-functional teams to address various data engineering challenges for the data science team and drive business impacts.  Responsibilities:Optimize data flows and collection, thereby improving the efficiency, capacity and reliability of our data operationsImplement processes and systems to monitor data quality, ensuring production data is always accurate and availableBringing innovation in the scalable data pipeline and infrastructure development and maintenanceAdd new sources, code business rules, and produce new metrics that support data science and security researchCreate and implement code, along with unit/integration tests, and applies coding patterns, guidelines, styles, and best practices; and adheres to all other requirementsContribute to data science and engineering internal documents and roadmap developmentWork closely with all business units and engineering teams to develop a strategy for long-term data architectureIndependently and consistently delivering high-quality data engineering support to the data scientists and security researchers.Requirements:More than 5 years of experience as a Software/Data Engineer, with significant experience working on SaaS products.Strong academic background in quantitative field (Computer Science, Engineering or Applied Mathematics)Proficient in managing and developing scalable data pipelines and automation of data workflows using Python & Spark / Scala.In-depth knowledge of AWS infrastructure and technology stacks for handling large datasets and table formats in a data lake environment.Experience in data models, data warehousing, building and optimizing ETL pipelinesDeep understanding and experience of orchestration tools, CI/CD paradigms, and SDLC best practices.Proven experience with SQL/NoSQL data warehouses.Skilled at optimizing large datasets and developing operational processes that improve data quality.Familiarity with container technologies such as Docker and Kubernetes.Experience in managing and communicating data warehouse plans.Ability to clearly present findings to business leaders and technical stakeholdersPreferred:Previous Experience in working closely with data scientists and cross-functional teams, supporting and driving innovation and research initiativesAn understanding of agile methodologies and an ability to adapt in a fast-paced, dynamic environment.Experience in transforming complex, large-scale datasets into actionable insights.Exposure to Machine Learning Operations (MLOps) strategies and architectures.Forward-thinking mentality, not afraid to venture into uncharted territories and eagerly taking on any other tasks that might arise.  Diversity. Bitsight is proud to be an equal opportunity employer. This means we do not tolerate discrimination of any kind and are committed to providing equal employment opportunities regardless of your gender identity, race, nationality, religion, sexual orientation, status as a protected veteran, or status as an individual with a disability.Culture. We put our people first. Bitsight offers best in class benefits. We devote the same energy to nurturing our company's inclusive culture as we apply to serving our customers' needs. Working at Bitsight will give you the opportunity to fulfill your professional goals and expand your skills.Open-minded. If you got to this point, we hope you’re feeling excited about the job description you just read.  Even if you don’t feel that you meet every single requirement, we still encourage you to apply.  We’re eager to meet people that believe in Bitsight’s mission and can contribute to our team in a variety of ways.Additional Information for United States of America Applicants:Bitsight also provides reasonable accommodations to qualified individuals with disabilities or based on a sincerely held religious belief in accordance with applicable laws. If you need to inquire about a reasonable accommodation, or need assistance with completing the application process, please email recruiting@bitsight.com. This contact information is for accommodation requests only, and cannot be used to inquire about the status of applications.Qualified applicants with criminal histories will be considered for employment consistent with applicable law.This position may be considered a promotional opportunity pursuant to the Colorado Equal Pay for Equal Work Act.The anticipated hiring base salary range for this position is US$140,000 to $160,000 annually for US-based employees.  This range reflects the minimum and maximum target for new hire salaries for the position across all US locations, is based on a full-time work schedule, and is Bitsight’s good faith estimate as of the date of this posting.  Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training.In addition to base salary, this role is eligible for participation in a bonus or commission plan and an equity grant.  Bitsight also offers a competitive benefits package, including but not but limited to medical, dental, and vision insurance; paid parental leave; flexible time off; a 401(k) plan with employee and company contribution opportunities; life and disability insurance; and tuition reimbursement.SummaryLocation: Boston, MA; Raleigh, NCType: Full time