Data Engineer

Perplexity is seeking an experienced Data Engineer to help revolutionize the way people search and interact online. In this role, you'll help build Perplexity's end-to-end data stack and flywheel. Perplexity is rapidly scaling both in number of use cases and number of users. Perplexity's data stack powers scalable, personalized and fast answers for millions of people worldwide. Tech Stack: Databricks | PySpark | AWS | RDS | DynamoDB | Docker | EKS | DBT Responsibilities Collaborating closely with Product, Backend, and Data Science teams to design, build, and maintain scalable data pipelines and infrastructure Developing, deploying, and monitoring data pipelines for ingestion, transformation, and storage at high scale Designing and implementing tools and abstractions on top of data infrastructure for a variety of analytics, recommendations, and machine learning use cases Designing and maintaining data orchestration and streaming pipelines Working closely with product teams to develop reusable data resources and design patterns Qualifications Strong programming and data engineering skills, with proficiency in distributed data processing (AWS, PySpark, Databricks) Strong quantitative skills with experience in estimating performance at high scale Familiarity with cloud-based data services (e.g., AWS, RDS, DynamoDB), containerized infrastructure (e.g., EKS, Docker), and data streaming (Flink, Spark streaming, CDC) Self-motivated with a strong sense of ownership of systems and designs 4 years of industry experience in data engineering The cash compensation range for this role is $200,000 - $250,000. At Perplexity, we've experienced tremendous growth and adoption since publicly launching the world's first fully functional conversational answer engine just over a year ago. Our AI-powered search assistant has amassed 10 million monthly active users as of early 2024, with our mobile apps installed over 1 million times across iOS and Android devices. In 2023 alone, we served over 500 million queries from users around the globe. To support our rapid expansion, we've raised significant funding from some of the most respected investors in technology. In January 2024, we raised $73.6 million in a Series B round led by IVP, with participation from NVIDIA, Jeff Bezos' investment fund, NEA, Databricks, and other prominent firms. We followed that up with a $62.7 million Series B1 round in April 2024 led by Daniel Gross, valuing Perplexity at over $1 billion. Our prominent investor base includes IVP, NEA, Jeff Bezos, NVIDIA, Databricks, Bessemer Venture Partners, Elad Gil, Nat Friedman, Naval Ravikant, Tobi Lutke, and many other visionary individuals. Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above. Equity: In addition to the base salary, equity is part of the total compensation package. Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.