Data Engineer

Job Type Full-time Description About Us: Welcome to RTS, the innovation lab where data meets discovery As a premier AI, Data, and Software consulting firm, we specialize in harnessing the power of data to brew up groundbreaking solutions that drive businesses forward. If you're a data wizard with a passion for experimentation and innovation, we want you in our lab Join us as our new Data Engineer and help us turn raw data into powerful insights. Job Description We are seeking a Data Engineer to join our elite lab team, leveraging your expertise in dbt, Snowflake, SQL, Azure Databricks, and Azure Data Factory to create high-performance data pipelines and transformative solutions. As a Lead Data Scientist in the Lab, you will perform cutting-edge data "experiments," synthesizing raw data into valuable insights for our clients. With your toolbox of advanced technologies, you'll design robust data workflows and pipelines, ensuring smooth and scalable data operations in the cloud. Key Responsibilities: Data Experiments & Workflow : Use dbt to transform, clean, and model raw data, creating optimized data workflows that deliver clean, reliable datasets. Data Pipeline Creation : Design and build automated ETL/ELT pipelines using Azure Data Factory to streamline data ingestion and transformation from various sources. Snowflake Integration : Implement Snowflake as the core data warehousing solution, ensuring efficient data storage, query performance, and scalability. Advanced Data Processing : Leverage Azure Databricks to perform large-scale data processing and build machine learning models, handling massive datasets with ease. SQL Magic : Write and optimize complex SQL queries to extract, manipulate, and analyze data for enhanced performance. Pipeline Optimization : Continuously test, troubleshoot, and refine pipelines to ensure high availability and performance. Collaboration Across Teams : Work with data scientists, engineers, and business stakeholders to understand data requirements and deliver best-in-class data solutions. Required Skills & Experience: Strong hands-on experience with dbt, Snowflake, SQL, Azure Databricks, and Azure Data Factory. Proven ability to design and implement scalable ETL/ELT data pipelines in a cloud environment. Experience working with large datasets and processing them through distributed systems like Azure Databricks. Strong SQL skills for data querying, manipulation, and optimization. Knowledge of data warehousing, data modeling, and data governance best practices. Strong problem-solving abilities and an experimental mindset, constantly searching for ways to improve performance and efficiency. Preferred Qualifications: Experience working in Azure cloud environments. Familiarity with CI/CD pipelines for continuous integration and deployment of data pipelines. Experience with data visualization tools and how they integrate with back-end data pipelines. Ability to communicate complex technical concepts to non-technical stakeholders. Lab Perks (What We Offer): Do you prefer Mac or PC? Either way, you get to choose with us 40 hours a year for professional development to use how you choose Flexible PTO Company values that we actually implement ( https://rtslabs.com/culture/ ) Family first approach, no micro-management RTS Labs is committed to providing a safe and inclusive environment for all employees, contractors, vendors, and clients; where all people are honored and respected, and differences are celebrated. Proud to be an Equal Opportunity Employer, RTS Labs does not discriminate based upon race, religion, color, national origin, gender, gender identity, gender expression, sexual orientation, age, status as a protected veteran, or status as an individual with a disability.