Dremio
Senior Software Engineer - Query Planner & Reflections
Dremio, Seattle, Washington, us, 98127
Be Part of Building the Future
Dremio is the unified lakehouse platform for self-service analytics and AI, serving hundreds of global enterprises, including Maersk, Amazon, Regeneron, NetApp, and S&P Global. Customers rely on Dremio for cloud, hybrid, and on-prem lakehouses to power their data mesh, data warehouse migration, data virtualization, and unified data access use cases. Based on open source technologies, including Apache Iceberg and Apache Arrow, Dremio provides an open lakehouse architecture enabling the fastest time to insight and platform flexibility at a fraction of the cost. Learn more at www.dremio.com.
About the role
In this role, you will work on some of Dremio's core features, including Reflections-a key feature of Dremio's query engine that combines the power of materialized views with sophisticated automatic query rewrites through deep integration in Dremio's distributed query optimizer. You will grow as a leader through mentoring, collaborating with other developers and taking ownership of complex issues to deliver high quality distributed systems at a massive scale.What you'll be doingOwn design, implementation, testing, and support of next-generation features related to Dremio's Query Planner and Reflections technologiesWork with open source projects like Apache Calcite and Apache IcebergUse modular design patterns to deliver an architecture that's elegant, simple, extensible and maintainableSolve complex technical problems and customer issues while improving our telemetry and instrumentation to proactively detect issues before they arise and make debugging more efficientDesign and deliver architectures that run optimally on public clouds like GCP, AWS, and AzureMentor other team members for high quality and designCollaborate with Product Management to innovate and deliver on customer requirements and with Support and field teams to ensure customer successWhat we're looking forB.S./M.S/Equivalent in Computer Science or a related technical field or equivalent experience5+ years of experience developing production-level softwareFluency in Java/C++Strong foundation in data structures, algorithms, multi-threaded and asynchronous programming models, and their use in developing distributed and scalable systemsStrong database fundamentals including SQL, performance, and schema design is a big plusExperience in developing complex and scalable distributed systems and delivering, deploying, and managing microservices successfullyPassion for learning, quality, zero downtime upgrades, availability, resiliency, uptime of the platform, and using latest technologiesAbility to solve ambiguous, unexplored, and cross-team problems effectivelyUnderstanding of distributed file systems such as S3, ADLS, or HDFSExperience with AWS, Azure, and Google Cloud Platform and background in large scale data processing systems (e.g., Hadoop, Spark, etc.) is a plusAbility to scope and plan solutions for big problems and mentors others on the sameInterested and motivated to be part of a fast-moving startup with a fun and accomplished teamBonus points if you haveExperience with materialized views and incremental view maintenance.Experience with distributed query engines.Hands on experience in query processing or optimization, distributed systems, concurrency control, data replication, code generation, networking, storage systems, heap management, Apache Arrow, SQL Operators, caching techniques, and disk spillingHands on experience with multi-threaded and asynchronous programming modelsWhat we offerMedical, dental and vision insurance401(k) PlanShort term / long term disability and life insurancePre-IPO stock optionsFlexible PTO16 hours of volunteer time off12 company paid holidays, including JuneteenthRemote work optionsMonthly "Get Stuff Done" (GSD) DaysPaid parental leaveEmployee Assistance Program (EAP)Quarterly swag surprise
**Certain benefits are only allowed to full-time Dremio employees and may not be the same across all locations. #LI-Remote #LI-JW1
The compensation range for this position is $153,00 to $188,000 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate's geographic region, job-related knowledge, skills, and experience among other factors. Depending on the position offered, the on target earnings (OTE) may include a bonus or commission.Return to Office Philosophy
Workplace Wednesdays - to break down silos, build relationships and improve cross-team communication, Gnarlies who live within a 1-hour commuting distance (one-way) to a Dremio office come to the office. Lunch catering / meal credits provided in the office and local socials align to Workplace Wednesdays. In general, Dremio will remain a hybrid work environment. We will not be implementing a 100% (5 days a week) return to office policy for all roles.
#LI-JF1
What we value
At Dremio, we hold ourselves to high standards when it comes to People, Thinking, and Action. Our Gnarlies (that's what we call our employees) communicate with clarity, drive accountability, and are respectful towards each other. We confront brutal facts and focus on results while operating with a sense of urgency and building a "flywheel". People who like to jump in and drive momentum will thrive in our #GnarlyLife.
Dremio is an equal opportunity employer supporting workforce diversity. We do not discriminate on the basis of race, religion, color, national origin, gender identity, sexual orientation, age, marital status, protected veteran status, disability status, or any other unlawful factor.
Dremio is committed to providing any necessary accommodations for individuals with disabilities within our application and interview process. To request accommodation due to a disability, please inform your recruiter.
Dremio has policies in place to protect the personal information that employees and applicants disclose to us. Please click here to review the privacy notice.Important Security Notice for Candidates
At Dremio, we uphold trust and transparency as paramount values in all our interactions with customers, partners, employees, and the general public. We have been targeted by individuals creating fake domains similar to ours to scam prospects and candidates. Please note that all official communications from us will be from an @dremio.com domain. If you suspect you've been targeted by a scam, it's imperative to report the incident to your local law enforcement agencies. For more information about this type of scam, please refer to Dremio's official statement here.
Dremio is the unified lakehouse platform for self-service analytics and AI, serving hundreds of global enterprises, including Maersk, Amazon, Regeneron, NetApp, and S&P Global. Customers rely on Dremio for cloud, hybrid, and on-prem lakehouses to power their data mesh, data warehouse migration, data virtualization, and unified data access use cases. Based on open source technologies, including Apache Iceberg and Apache Arrow, Dremio provides an open lakehouse architecture enabling the fastest time to insight and platform flexibility at a fraction of the cost. Learn more at www.dremio.com.
About the role
In this role, you will work on some of Dremio's core features, including Reflections-a key feature of Dremio's query engine that combines the power of materialized views with sophisticated automatic query rewrites through deep integration in Dremio's distributed query optimizer. You will grow as a leader through mentoring, collaborating with other developers and taking ownership of complex issues to deliver high quality distributed systems at a massive scale.What you'll be doingOwn design, implementation, testing, and support of next-generation features related to Dremio's Query Planner and Reflections technologiesWork with open source projects like Apache Calcite and Apache IcebergUse modular design patterns to deliver an architecture that's elegant, simple, extensible and maintainableSolve complex technical problems and customer issues while improving our telemetry and instrumentation to proactively detect issues before they arise and make debugging more efficientDesign and deliver architectures that run optimally on public clouds like GCP, AWS, and AzureMentor other team members for high quality and designCollaborate with Product Management to innovate and deliver on customer requirements and with Support and field teams to ensure customer successWhat we're looking forB.S./M.S/Equivalent in Computer Science or a related technical field or equivalent experience5+ years of experience developing production-level softwareFluency in Java/C++Strong foundation in data structures, algorithms, multi-threaded and asynchronous programming models, and their use in developing distributed and scalable systemsStrong database fundamentals including SQL, performance, and schema design is a big plusExperience in developing complex and scalable distributed systems and delivering, deploying, and managing microservices successfullyPassion for learning, quality, zero downtime upgrades, availability, resiliency, uptime of the platform, and using latest technologiesAbility to solve ambiguous, unexplored, and cross-team problems effectivelyUnderstanding of distributed file systems such as S3, ADLS, or HDFSExperience with AWS, Azure, and Google Cloud Platform and background in large scale data processing systems (e.g., Hadoop, Spark, etc.) is a plusAbility to scope and plan solutions for big problems and mentors others on the sameInterested and motivated to be part of a fast-moving startup with a fun and accomplished teamBonus points if you haveExperience with materialized views and incremental view maintenance.Experience with distributed query engines.Hands on experience in query processing or optimization, distributed systems, concurrency control, data replication, code generation, networking, storage systems, heap management, Apache Arrow, SQL Operators, caching techniques, and disk spillingHands on experience with multi-threaded and asynchronous programming modelsWhat we offerMedical, dental and vision insurance401(k) PlanShort term / long term disability and life insurancePre-IPO stock optionsFlexible PTO16 hours of volunteer time off12 company paid holidays, including JuneteenthRemote work optionsMonthly "Get Stuff Done" (GSD) DaysPaid parental leaveEmployee Assistance Program (EAP)Quarterly swag surprise
**Certain benefits are only allowed to full-time Dremio employees and may not be the same across all locations. #LI-Remote #LI-JW1
The compensation range for this position is $153,00 to $188,000 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate's geographic region, job-related knowledge, skills, and experience among other factors. Depending on the position offered, the on target earnings (OTE) may include a bonus or commission.Return to Office Philosophy
Workplace Wednesdays - to break down silos, build relationships and improve cross-team communication, Gnarlies who live within a 1-hour commuting distance (one-way) to a Dremio office come to the office. Lunch catering / meal credits provided in the office and local socials align to Workplace Wednesdays. In general, Dremio will remain a hybrid work environment. We will not be implementing a 100% (5 days a week) return to office policy for all roles.
#LI-JF1
What we value
At Dremio, we hold ourselves to high standards when it comes to People, Thinking, and Action. Our Gnarlies (that's what we call our employees) communicate with clarity, drive accountability, and are respectful towards each other. We confront brutal facts and focus on results while operating with a sense of urgency and building a "flywheel". People who like to jump in and drive momentum will thrive in our #GnarlyLife.
Dremio is an equal opportunity employer supporting workforce diversity. We do not discriminate on the basis of race, religion, color, national origin, gender identity, sexual orientation, age, marital status, protected veteran status, disability status, or any other unlawful factor.
Dremio is committed to providing any necessary accommodations for individuals with disabilities within our application and interview process. To request accommodation due to a disability, please inform your recruiter.
Dremio has policies in place to protect the personal information that employees and applicants disclose to us. Please click here to review the privacy notice.Important Security Notice for Candidates
At Dremio, we uphold trust and transparency as paramount values in all our interactions with customers, partners, employees, and the general public. We have been targeted by individuals creating fake domains similar to ours to scam prospects and candidates. Please note that all official communications from us will be from an @dremio.com domain. If you suspect you've been targeted by a scam, it's imperative to report the incident to your local law enforcement agencies. For more information about this type of scam, please refer to Dremio's official statement here.