Alcority
Lead Data Engineer
Alcority, Dallas, Texas, United States, 75215
We are seeking a highly skilled and experienced Lead Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, data warehousing, and cloud platforms. This role will involve leading the design and development of robust data pipelines, streaming ingestion frameworks, and scalable data architectures to support our data-driven initiatives. You will collaborate closely with cross-functional teams to ensure data integrity, availability, and accessibility across the organization.
Key Responsibilities:
Lead the design, development, and maintenance of scalable data pipelines, ETL/ELT processes, and data models.
Focus on Kafka, HDFS, HBase, Parquet, Spark, and Flink to ensure efficient data ingestion, storage, and processing.
Build and manage data ingestion frameworks using big data technologies, ensuring high efficiency and reliability.
Develop and optimize data storage solutions, including data warehousing, data lakes, and NoSQL databases on cloud platforms such as AWS, Azure, or Google Cloud.
Collaborate with data scientists, analysts, and business stakeholders to understand data needs and deliver solutions that meet those needs.
Ensure data quality, governance, and security through the implementation of best practices and robust monitoring systems.
Work with various data formats, including Parquet, Avro, and others, to ensure efficient data processing and storage.
Mentor and provide technical leadership to junior data engineers, fostering a culture of continuous learning and improvement.
Qualifications:
Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree preferred.
3+ years of proven experience as a Data Engineer or in a similar role, with a strong focus on data warehousing, ETL/ELT processes, and data modeling.
Proficiency in programming languages such as Python, Java, or Scala.
Hands-on experience with big data technologies such as Kafka, Spark, HDFS, HBase, Flink, DBT, SQLMesh, etc.
Experience with cloud platforms such as AWS, Azure, or Google Cloud.
Strong SQL skills and experience working with both relational and NoSQL databases.
Familiarity with data visualization tools such as Tableau, Power BI, or Looker.
Excellent problem-solving and analytical skills.
Strong communication and collaboration skills, with the ability to work effectively in a team environment.
Preferred Qualifications:
Experience with building and managing data pipelines in a multi-cloud environment.
Familiarity with data governance and data quality frameworks.
Experience in mentoring or leading a team of data engineers.
It is impossible to list every requirement for, or responsibility of, any position. Similarly, we cannot identify all the skills a position may require since job responsibilities and the Company's needs may change over time. Therefore, the above job description is not comprehensive or exhaustive. The Company reserves the right to adjust, add to or eliminate any aspect of the above description. The Company also retains the right to require all employees to undertake additional or different job responsibilities when necessary to meet business needs.
Must be legally authorized to work in the United States without the need for employer sponsorship, now or at any time in the future.
Benefits & Perks:
Time Off:
25 days of PTO for full-time employees and 12 company holidays.
Company Paid Benefits:
Life insurance, Short-term disability, Long-term disability, Paid parental leave, Employee Assistance Program, and medical insurance in our high deductible health plan.
Optional Employee Paid Benefits:
Medical insurance in our EPO plan, Dental benefits, and Vision benefits. We also offer Health Savings Accounts, Flexible Spending Accounts, Supplemental Life insurance, and more.
401(k):
Eligible after 60 days. Discretionary company match of 50% up to the first 6% of contributions.
EQUAL OPPORTUNITY EMPLOYER
ALCORITY IS AN EQUAL EMPLOYMENT OPPORTUNITY EMPLOYER. THE COMPANY'S POLICY IS NOT TO DISCRIMINATE AGAINST ANY APPLICANT OR EMPLOYEE BASED ON RACE, COLOR, RELIGION, NATIONAL ORIGIN, GENDER, AGE, SEXUAL ORIENTATION, GENDER IDENTITY OR EXPRESSION, MARITAL STATUS, MENTAL OR PHYSICAL DISABILITY, AND GENETIC INFORMATION, OR ANY OTHER BASIS PROTECTED BY APPLICABLE LAW. THE FIRM ALSO PROHIBITS HARASSMENT OF APPLICANTS OR EMPLOYEES BASED ON ANY OF THESE PROTECTED CATEGORIES.
Key Responsibilities:
Lead the design, development, and maintenance of scalable data pipelines, ETL/ELT processes, and data models.
Focus on Kafka, HDFS, HBase, Parquet, Spark, and Flink to ensure efficient data ingestion, storage, and processing.
Build and manage data ingestion frameworks using big data technologies, ensuring high efficiency and reliability.
Develop and optimize data storage solutions, including data warehousing, data lakes, and NoSQL databases on cloud platforms such as AWS, Azure, or Google Cloud.
Collaborate with data scientists, analysts, and business stakeholders to understand data needs and deliver solutions that meet those needs.
Ensure data quality, governance, and security through the implementation of best practices and robust monitoring systems.
Work with various data formats, including Parquet, Avro, and others, to ensure efficient data processing and storage.
Mentor and provide technical leadership to junior data engineers, fostering a culture of continuous learning and improvement.
Qualifications:
Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree preferred.
3+ years of proven experience as a Data Engineer or in a similar role, with a strong focus on data warehousing, ETL/ELT processes, and data modeling.
Proficiency in programming languages such as Python, Java, or Scala.
Hands-on experience with big data technologies such as Kafka, Spark, HDFS, HBase, Flink, DBT, SQLMesh, etc.
Experience with cloud platforms such as AWS, Azure, or Google Cloud.
Strong SQL skills and experience working with both relational and NoSQL databases.
Familiarity with data visualization tools such as Tableau, Power BI, or Looker.
Excellent problem-solving and analytical skills.
Strong communication and collaboration skills, with the ability to work effectively in a team environment.
Preferred Qualifications:
Experience with building and managing data pipelines in a multi-cloud environment.
Familiarity with data governance and data quality frameworks.
Experience in mentoring or leading a team of data engineers.
It is impossible to list every requirement for, or responsibility of, any position. Similarly, we cannot identify all the skills a position may require since job responsibilities and the Company's needs may change over time. Therefore, the above job description is not comprehensive or exhaustive. The Company reserves the right to adjust, add to or eliminate any aspect of the above description. The Company also retains the right to require all employees to undertake additional or different job responsibilities when necessary to meet business needs.
Must be legally authorized to work in the United States without the need for employer sponsorship, now or at any time in the future.
Benefits & Perks:
Time Off:
25 days of PTO for full-time employees and 12 company holidays.
Company Paid Benefits:
Life insurance, Short-term disability, Long-term disability, Paid parental leave, Employee Assistance Program, and medical insurance in our high deductible health plan.
Optional Employee Paid Benefits:
Medical insurance in our EPO plan, Dental benefits, and Vision benefits. We also offer Health Savings Accounts, Flexible Spending Accounts, Supplemental Life insurance, and more.
401(k):
Eligible after 60 days. Discretionary company match of 50% up to the first 6% of contributions.
EQUAL OPPORTUNITY EMPLOYER
ALCORITY IS AN EQUAL EMPLOYMENT OPPORTUNITY EMPLOYER. THE COMPANY'S POLICY IS NOT TO DISCRIMINATE AGAINST ANY APPLICANT OR EMPLOYEE BASED ON RACE, COLOR, RELIGION, NATIONAL ORIGIN, GENDER, AGE, SEXUAL ORIENTATION, GENDER IDENTITY OR EXPRESSION, MARITAL STATUS, MENTAL OR PHYSICAL DISABILITY, AND GENETIC INFORMATION, OR ANY OTHER BASIS PROTECTED BY APPLICABLE LAW. THE FIRM ALSO PROHIBITS HARASSMENT OF APPLICANTS OR EMPLOYEES BASED ON ANY OF THESE PROTECTED CATEGORIES.