Lead Data Engineer

Lead Data Engineer Job Locations US-NY-New York ID 2024-6283 of Openings 0 Category Information Technology Work Location Type Physical Overview At New York Blood Center Enterprises (NYBCe), one of the most comprehensive blood centers in the world, our focus is on cultivating excellence by merging cutting-edge innovation with diligent customer service, groundbreaking research, and comprehensive program and service development. Join us as we work towards meeting and exceeding the growing needs of our diverse communities, further our lifesaving strategic goals in a rapidly changing environment, and expand our impact on the local, national, and global communities we serve. Responsibilities As the Lead Data Engineer , you get to innovate at the intersection of technology and human compassion crafting the backbone of our infrastructure. Your role is pivotal, serving as a key architect developing data solutions that directly impact lives. Every algorithm is a potential lifeline for patients relying on timely blood transfusions. Think of yourself as a master builder of intricate systems that support all functions across our organization to ensure the highest standards for our blood centers. But your job isn't just about the numbers, you're also passionate about making a difference. Knowing patients rely on what you do inspires you to execute effective strategies. You are a leader in every sense of the word, encouraging your teams in a hands-on capacity to drive business impact so everyone feels part of this rewarding experience. At [New York] Blood Center, you are all of these things and more. New York Blood Center was established by hospitals in New York s a private, not for profit agency. Today we are part of the New York Blood Center and are among the nation's premium providers of blood products and services. We're looking for skilled data enthusiast leaders who enjoy developing innovative solutions and get a strong sense of fulfillment working within the healthcare community. Here's how you can help us make a difference Candidates must be able to report into one of the following NYBCe locations:New York City, NY; Kansas City, Missouri; St. Paul, Minnesota; Providence , RI and Newark, DE. Primary Responsibilities: Data Overseer: Lead the architectural design and optimization of robust, scalable data pipelines using SQL, Python, and cloud-based ETL tools such as Databricks. Oversee data flow and processing to support large-scale operations and ensure system-wide efficiency. Use your skills as a guru to lead teams. Data Maestro Director: Direct the development of complex data models to accurately mirror critical business processes, ensuring seamless integration with our comprehensive data architecture, including Big Data frameworks like Spark. Insights Wrangler: Shape and enhance our data architecture strategy, making high-level decisions on data storage, consumption, integration, and management across cloud platforms (Azure, AWS, or Google Cloud). Information Artisan: Orchestrate Agile/SCRUM frameworks to drive efficient project delivery. Lead sprints and stand-up meetings, implementing strategies to optimize processes across teams. Lead Wizard and Sage: Guide collaboration efforts with data scientists, BI teams, and engineering groups to translate intricate data requirements into executable engineering strategies. Mentor senior teams for continuous growth, nurturing a culture of excellence. Purveyors of Standard Procedures: Establish and enforce the highest data quality standards and governance policies, ensuring reliability and regulatory compliance across all data operations. Analytical Guardians: Continuously monitor and refine the performance of data infrastructure, resolving high-level bottlenecks in cloud and Big Data environments. Information Oracle: Stay at the forefront of emerging data engineering technologies and methodologies, leading implementation of innovative practices that enhance our capabilities. Your work at [New York] Blood Center directly impacts patient care by providing clinicians with valuable data for diagnosis and treatment. Join us in our passion for helping others. Qualifications Education: Bachelor's Degree in Computer Science, Data Science, Information Technology or other quantitative disciplines such as Science, Statistics, Economics, or Mathematics. Essential Experience: 10 years of progressive experience in data engineering, with proven expertise in designing, implementing, and leading initiatives for optimizing databases and data pipelines. Extensive hands-on experience with SQL Server, Oracle, or other relational database management systems (RDBMS). Advanced proficiency in SQL and Python for sophisticated data manipulation and analytics. Demonstrated leadership in data modeling and architecture for both analytics and transactional systems within large-scale environments. At least 2 years of experience leading teams of data engineers: Proven ability to mentor and guide teams in the development and optimization of data systems, fostering a collaborative and innovative working environment. Cloud and Big Data Experience: Expertise with at least one major cloud data platform (Azure, AWS, Google Cloud) with extensive application in data engineering projects. Deep knowledge of Big Data technologies such as Spark and Cloud ETL tools like Databricks, with a focus on scalability and real-time processing capabilities. Methodology and Tools: Senior-level experience with Agile and SCRUM methodologies, leading successful project delivery in a dynamic development environment. Skilled in developing data models for integration and analysis that support complex business intelligence and data analytics initiatives. Any combination of education, training, and experience equivalent to the requirements above that has supplied the necessary knowledge, skills, and experience to perform the essential functions of the job. Required Knowledge, Skills & Abilities: Knowledge Fluent Communication: Ability to articulate complex data concepts and project updates clearly to both technical and non-technical stakeholders. Strong Data Analysis Ability: Expertise in analyzing large datasets to derive insights and inform business decisions. Proficiency in SQL and Python: High level of skill in SQL and Python for data analysis, data manipulation and scripting. ETL/ELT Architecture: In-depth knowledge of developing and managing ETL and ELT architectures using various tools and frameworks. Cloud Experience: Experience with cloud platforms such as Azure, AWS, or Google Cloud, and their respective data services and tools. Big Data Concepts: Understanding of Big Data technologies and frameworks, including Spark and Cloud ETL tools such as Databricks. Agile and SCRUM Knowledge: Familiarity with Agile methodologies and SCRUM practices, capable of integrating these into project management and daily workflows. Quality Assurance and Data Governance: Knowledge of data quality standards and governance, ensuring data integrity and compliance across all processes. Skills Collaboration: Ability to work effectively with cross-functional teams, including data scientists, BI analysts, and software engineers, to implement data solutions. Mentorship and Leadership: Skills in mentoring junior engineers and leading project teams to promote knowledge sharing and professional growth within the team. Innovation and Continuous Learning: Commitment to staying updated on the latest industry trends and technologies in data engineering and implementing them as relevant. Abilities Ability to interact with customers one-on-one or in large groups Ability to work independently with remote supervision. Ability to build in receiving feedback as part of the development process, and seek consistent and constructive feedback. Ability to embrace accountability and ownership. Peferred Qualifications: Education: Master's Degree in Computer Science, Data Science, Information Technology or other quantitative disciplines such as Science, Statistics, Economics, or Mathematics. Experience with the Microsoft Azure technology stack or similar technologies in competing platforms. Practical knowledge of data analytics and visualization tools to aid in data-driven decision making and reporting. Certifications & Licenses: Professional certification in Agile and SCRUM methodologies (e.g., Certified ScrumMaster (CSM), SAFe Agilist). Certifications in Python and SQL programming (e.g., Microsoft Certified: Python Programming Specialist, Oracle SQL Certification). Certifications in cloud services relevant to the job (e.g., AWS Certified Solutions Architect, Google Professional Data Engineer, Microsoft Certified: Azure Data Engineer Associate). Big Data certifications (e.g., Cloudera Certified Professional (CCP): Data Engineer, Databricks Certified Professional Data Scientist). Willing to attain certification, if not currently certified. For applicants who will perform this position in New York City or Westchester County, the proposed annual salary is $150,000.00 p/yr. to $160,000.00 p/yr. For applicants who will perform this position outside of New York City or Westchester County, salary will reflect local market rates and be commensurate with the applicant's skills, job-related knowledge, and experience. Unless otherwise specified, all posted opportunities are located in the New York or Greater Tri-State office locations.