FlexGen®
Lead Data Engineer
FlexGen®, Durham, North Carolina, United States, 27703
About FlexGen
Based in Durham, N.C., FlexGen is a leading integration services and software technology provider for utility-scale energy storage solutions in the United States and globally. FlexGen designs and integrates storage solutions and the software platform that is enabling today's energy transition. Leveraging its best-in-class energy management software, digital controls, and advanced analytics, FlexGen delivers energy storage projects integrated with traditional and renewable power generation globally. FlexGen's products and services help improve the reliability and sustainability of the power grid. The company's clients and partners include the most technically and commercially demanding developers, utilities, renewable energy, electric cooperatives, and industrial companies in the world.
Position Description
FlexGen makes software that makes a difference in the world. With HybridOS our customers can put more battery storage on to the grid quicker and easier and then keep it running effectively. Traditional energy management systems are often custom developed from the ground up each time a customer builds a project. FlexGen applies modern technologies and product development principles to deliver software that gets the job done, is easy to learn and a joy to use.
We are looking for an experienced Data Engineer to architect, implement, and maintain our diverse data infrastructure. The ideal candidate will have a strong background in cloud services and experience working with large-scale data processing systems. You will be responsible for designing and implementing data pipelines, ensuring data quality, and optimizing data processing performance. You will work closely with our data science and web development teams to deliver valuable insights and be a crucial part of our data-driven strategy.
Major Job Responsibilities:Architect, troubleshoot, and maintain a scalable, reliable, and cost-effective data infrastructure designed to move large timeseries datasets in near-real time for various end usesEnsure data quality and integrity through continuous data validation, monitoring, and anomaly detectionOptimize data processing performance by leveraging best practices, such as data partitioning, compression, and cachingDevelop and maintain data catalog and schema management systems to facilitate data discovery and governanceCollaborate with the team to establish proper software development lifecycle (SDLC) processes, including version control, code reviews, and continuous integrationMentor and provide guidance to junior team members, fostering a culture of collaboration and continuous learningThe technologies you may use for this role include:
On-premises databases: InfluxDB, PostgreSQLData formats: ParquetMessage brokers: MQTTAWS services: Lambda, Glue, Timestream, RDS, Data LakeExperienced in one or more of the following languages: SQL, Python, Go, RustETL/ELT processesData modeling and warehousing concepts
Position Requirements:
Bachelor's or Master's degree in Computer Science, Engineering, or a related field5+ years of experience in data engineering, preferably in a cloud-based environment (AWS experience preferred)Strong understanding of data modeling, data warehousing, and ETL conceptsExperience with streaming and/or timeseries dataExpertise in designing and implementing efficient data models
FlexGen provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability or genetics. In addition to federal law requirements, FlexGen complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.
FlexGen expressly prohibits any form of workplace harassment based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
To the extent permitted by law, employees are subject to periodic random drug testing, and post-accident and reasonable suspicion drug and alcohol testing.
Based in Durham, N.C., FlexGen is a leading integration services and software technology provider for utility-scale energy storage solutions in the United States and globally. FlexGen designs and integrates storage solutions and the software platform that is enabling today's energy transition. Leveraging its best-in-class energy management software, digital controls, and advanced analytics, FlexGen delivers energy storage projects integrated with traditional and renewable power generation globally. FlexGen's products and services help improve the reliability and sustainability of the power grid. The company's clients and partners include the most technically and commercially demanding developers, utilities, renewable energy, electric cooperatives, and industrial companies in the world.
Position Description
FlexGen makes software that makes a difference in the world. With HybridOS our customers can put more battery storage on to the grid quicker and easier and then keep it running effectively. Traditional energy management systems are often custom developed from the ground up each time a customer builds a project. FlexGen applies modern technologies and product development principles to deliver software that gets the job done, is easy to learn and a joy to use.
We are looking for an experienced Data Engineer to architect, implement, and maintain our diverse data infrastructure. The ideal candidate will have a strong background in cloud services and experience working with large-scale data processing systems. You will be responsible for designing and implementing data pipelines, ensuring data quality, and optimizing data processing performance. You will work closely with our data science and web development teams to deliver valuable insights and be a crucial part of our data-driven strategy.
Major Job Responsibilities:Architect, troubleshoot, and maintain a scalable, reliable, and cost-effective data infrastructure designed to move large timeseries datasets in near-real time for various end usesEnsure data quality and integrity through continuous data validation, monitoring, and anomaly detectionOptimize data processing performance by leveraging best practices, such as data partitioning, compression, and cachingDevelop and maintain data catalog and schema management systems to facilitate data discovery and governanceCollaborate with the team to establish proper software development lifecycle (SDLC) processes, including version control, code reviews, and continuous integrationMentor and provide guidance to junior team members, fostering a culture of collaboration and continuous learningThe technologies you may use for this role include:
On-premises databases: InfluxDB, PostgreSQLData formats: ParquetMessage brokers: MQTTAWS services: Lambda, Glue, Timestream, RDS, Data LakeExperienced in one or more of the following languages: SQL, Python, Go, RustETL/ELT processesData modeling and warehousing concepts
Position Requirements:
Bachelor's or Master's degree in Computer Science, Engineering, or a related field5+ years of experience in data engineering, preferably in a cloud-based environment (AWS experience preferred)Strong understanding of data modeling, data warehousing, and ETL conceptsExperience with streaming and/or timeseries dataExpertise in designing and implementing efficient data models
FlexGen provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability or genetics. In addition to federal law requirements, FlexGen complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.
FlexGen expressly prohibits any form of workplace harassment based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
To the extent permitted by law, employees are subject to periodic random drug testing, and post-accident and reasonable suspicion drug and alcohol testing.