Windfall
Lead Data Engineer
Windfall, San Francisco, California, United States, 94199
Windfall is seeking a Lead Data Engineer to join our core data team. As a Lead Data Engineer on our core data team, you will be building out the core data asset that everything else at Windfall is built on top of. Communication and collaboration are at the heart of Windfall, and you will work closely with our product, data science, and other engineering teams. You will personally design and build the pipelines for massive datasets, taking them all the way from inception to exploration to production and customer use.
We're on a mission to change how organizations perceive and use people data. And we hold true to our core values of: (1) Be an excellent communicator; (2) Operate with transparency; (3) Provide leverage, not optimization; (4) Make a difference every day; and (5) Act with integrity and trust.
Responsibilities:
Construct data pipelines to ingest and merge billions of individual entities into Windfall's core data assetWork closely with our data science team to run ML models on top of billions of data pointsBuild supporting data services and applications to orchestrate and monitor our data systemsSome technology you will use:
Cloud platform - GCPProgramming languages - Java, Python, and KotlinData warehouse & databases - BigQuery, Postgres, Scylla/CassandraDistributed processing frameworks - Dataflow (Apache Beam) and Apache SparkOrchestration - AirflowRequirements:
8+ years of professional data engineering experienceSignificant experience working with Apache Beam/Spark/Flink or MapReduceStrong Object-oriented programming abilityExpert knowledge of distributed data processingFamiliarity with different datastores, their differences, and appropriate usagesExperience at a sub-200 person companyYou communicate as well as you codeYou can simplify complex problems into simple solutionsYou balance a strong sense of ownership and responsibility in your work with collaboration and team alignmentYou are comfortable making trade-offs between quality, complexity, and speed-of-deliveryPreferred Qualifications:
Previous experience in a player-coach roleProven experience taking a large project from ideation to productionExperience leading greenfield projectsWorking knowledge of cloud-native data engineering infrastructure
Additional Information:
The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across California and Colorado. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. We also offer a comprehensive benefits package, which you can explore on our careers site.
California : Salary range is $140k - $200k
Colorado : Salary range is $120k - $200k
About Windfall
Windfall is a people intelligence and AI company that gives go-to-market teams actionable insights. By democratizing access to people data, organizations can intelligently prioritize go-to-market resources to drive greater business outcomes. Powered by best-in-class machine learning and propensity modeling, Windfall activates insights into workflows that engage the right people for each respective organization. More than 850 data-driven organizations use Windfall to power their business.
We comply with CCPA.
For more information on how we comply, review our privacy notice.
We're on a mission to change how organizations perceive and use people data. And we hold true to our core values of: (1) Be an excellent communicator; (2) Operate with transparency; (3) Provide leverage, not optimization; (4) Make a difference every day; and (5) Act with integrity and trust.
Responsibilities:
Construct data pipelines to ingest and merge billions of individual entities into Windfall's core data assetWork closely with our data science team to run ML models on top of billions of data pointsBuild supporting data services and applications to orchestrate and monitor our data systemsSome technology you will use:
Cloud platform - GCPProgramming languages - Java, Python, and KotlinData warehouse & databases - BigQuery, Postgres, Scylla/CassandraDistributed processing frameworks - Dataflow (Apache Beam) and Apache SparkOrchestration - AirflowRequirements:
8+ years of professional data engineering experienceSignificant experience working with Apache Beam/Spark/Flink or MapReduceStrong Object-oriented programming abilityExpert knowledge of distributed data processingFamiliarity with different datastores, their differences, and appropriate usagesExperience at a sub-200 person companyYou communicate as well as you codeYou can simplify complex problems into simple solutionsYou balance a strong sense of ownership and responsibility in your work with collaboration and team alignmentYou are comfortable making trade-offs between quality, complexity, and speed-of-deliveryPreferred Qualifications:
Previous experience in a player-coach roleProven experience taking a large project from ideation to productionExperience leading greenfield projectsWorking knowledge of cloud-native data engineering infrastructure
Additional Information:
The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across California and Colorado. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. We also offer a comprehensive benefits package, which you can explore on our careers site.
California : Salary range is $140k - $200k
Colorado : Salary range is $120k - $200k
About Windfall
Windfall is a people intelligence and AI company that gives go-to-market teams actionable insights. By democratizing access to people data, organizations can intelligently prioritize go-to-market resources to drive greater business outcomes. Powered by best-in-class machine learning and propensity modeling, Windfall activates insights into workflows that engage the right people for each respective organization. More than 850 data-driven organizations use Windfall to power their business.
We comply with CCPA.
For more information on how we comply, review our privacy notice.