Logo
Commonwealth of Massachusetts

Principal Data Engineer

Commonwealth of Massachusetts, Boston, Massachusetts, us, 02298


The Executive Office of Technology Services and Security (EOTSS) places our customers and constituents at the heart of everything we do. We offer responsive digital services and productivity tools to more than 40,000 state employees, who provide essential information and services to the citizens of the Commonwealth. We also serve constituents, providing them with digital services and tools that enable taxpayers, motorists, businesses, visitors, families, and other citizens to do business with the Commonwealth in a way that makes every interaction with government easier, faster, and more secure.The Massachusetts Data Office (MDO) at EOTSS is hiring a Principal Data Engineer to lead our engineering team. The MDO is the central data office for the Commonwealth. We manage enterprise data programs and initiatives and partner with state agencies to build analytics products that promote data transparency and facilitate evidence-based policy and decision-making.As a Principal Data Engineer, you’ll lead a team of Engineering professionals to develop and maintain smart, secure data systems and pipelines, enable analytics for data-driven decision-making, and build capacity for innovation in government. As part of the Commonwealth’s central data team, you’ll be on the front lines working to improve the value of our data systems across state government.A Principal Data Engineer on our team is:A technical expert leading a high-performance team to develop, construct, test, and maintain sound, secure data architectures that meet business needs.A team-oriented specialist who works collaboratively with business leaders, project managers, and across technical teams to build the right thing.A strategic thinker who improves the functionality and value of the Commonwealth’s data system.This position is a full-time opportunity .The work schedule for this position is Monday through Friday, 9:00AM to 5:00PM EST, in a hybrid remote arrangement with 2-4 days per month spent at the primary work location: One Ashburton Place, Boston, Massachusetts 02108. Applicants should be located within reasonable commuting distance from the primary work location.Duties and Responsibilities:Lead and help build a team of high-performing engineers.Stand up and maintain data infrastructure and data pipelines to process high volumes of complex data.Work with IT, administrative staff, and business stakeholders to develop and execute on business requirements.Identify, design, and implement internal process improvements, automate manual processes, optimize data delivery, and re-design infrastructure for greater scalability.Develop and review data management plans, architecture plans, data transfer plans, and data security and privacy plans, including event monitoring and auditing guidelines, to ensure that systems meet security and technical requirements.Develop and review standard operating procedures to meet high standards for data organization, quality, and security.Provide leadership in developing standards and best practices.Build analytics tools to provide actionable insights into operational efficiency, service delivery, and policy evaluation.Provide support to other technical staff for issue resolution.Deliver consistent and reliable processes and high-quality output on independent and team projects.Preferred Knowledge, Skills & Abilities:At least seven (7) years of demonstrated experience in data engineering, standing up and managing safe, secure, reliable data architectures, with at least three (3) years in a supervisory or team lead role.Experience organizing and processing large quantities of data for analysis.Experience working with business stakeholders to implement new data standards, technologies and systems that meet business needs.Strong proficiency in Python and SQL.Experience with current data science tools and methods, including machine learning (ML) and artificial intelligence (AI) frameworks.Proficiency with Github and version control systems.Proficiency with the AWS stack.Working, up-to-date knowledge of best practices for keeping data separated and secure.Experience with a team software development process: design, testing, coding, and peer reviews.Experience with continuous integration/continuous development (CI/CD) practices.Excellent verbal and written communication skills.Ability to manage multiple priorities and workstreams simultaneously and deliver under tight deadlines.Experience in an Agile work environment.Proficiency with Snowflake strongly recommended but not required.Education and Certifications:Bachelor’s Degree in computer science, computer engineering, information systems, data science or related field, or equivalent work experienceAWS or other cloud platform certifications a plus; Snowflake certification a plus.

#J-18808-Ljbffr