Three Pillars Recruiting
Data Engineer (Lakewood, NJ) - Fast Growing Digital SaaS Company
Three Pillars Recruiting, Lakewood, New Jersey, us, 08701
PLEASE CLICK
HERE
TO SEE
*ALL*
OF OUR JOB OPENINGS!
One of our clients is looking for a highly skilled Data Engineer with extensive experience in SQL Server, Python, ETL processes, data warehousing, and database performance tuning. The ideal candidate will have a deep understanding of data management, data transformation, and optimization techniques to support large-scale databases and data pipelines. This role is critical in ensuring efficient data processing and optimal database performance across their systems.
This role is 5 days in-office in Lakewood, NJ.
Key Responsibilities:
ETL Development and Maintenance: Design, implement, and maintain ETL processes to move and transform data from source systems to data warehouses or data lakes, ensuring data integrity and performance.Data Warehousing: Develop and optimize data warehouse architectures, including the creation of star/snowflake schemas, dimensional models, and maintaining historical data.Database Performance Tuning: Monitor and tune database performance, optimizing SQL queries, indexes, and configurations to ensure maximum performance and minimal downtime.Data Integration: Work with various data sources, including relational databases (SQL Server, PostgreSQL), NoSQL databases, APIs, and flat files, to ensure seamless data integration into the data warehouse or data pipeline.Database Administration: Manage and maintain SQL Server databases, performing tasks such as backup, restore, and disaster recovery planning.Automation: Develop scripts and workflows using Python (or other scripting languages) to automate routine tasks, data pipelines, and monitoring systems.Data Quality and Validation: Implement data quality checks, validation rules, and error handling to ensure data accuracy across systems.Collaboration: Work closely with business stakeholders, data analysts, and other engineers to understand data requirements, troubleshoot issues, and provide technical guidance.Required Skills & Qualifications:
Experience: 3+ years of experience in Data Engineering or a similar role.Technical Expertise:o Strong proficiency with SQL Server, including SSIS (SQL Server Integration Services) and SSRS (SQL Server Reporting Services).
o Advanced SQL query optimization and performance tuning experience.
o Experience with Python for data processing, automation, and scripting tasks.
o Strong understanding of ETL processes, data modeling, and data warehousing techniques.
o Experience with cloud platforms (Azure, AWS, or Google Cloud) and cloud-based data warehousing (e.g., Snowflake, Redshift, BigQuery) is a plus.
Tools & Technologies:o Experience with version control systems (Git, GitHub, etc.).
o Familiarity with job scheduling tools (Airflow, Apache NiFi, etc.).
o Familiarity with BI tools like Power BI or Tableau is a plus.
Problem-Solving: Strong analytical and problem-solving skills, particularly with data issues and performance bottlenecks.Communication: Excellent verbal and written communication skills, with the ability to explain complex data processes to both technical and non-technical stakeholders.
Job-2634051
*LI-MG1
HERE
TO SEE
*ALL*
OF OUR JOB OPENINGS!
One of our clients is looking for a highly skilled Data Engineer with extensive experience in SQL Server, Python, ETL processes, data warehousing, and database performance tuning. The ideal candidate will have a deep understanding of data management, data transformation, and optimization techniques to support large-scale databases and data pipelines. This role is critical in ensuring efficient data processing and optimal database performance across their systems.
This role is 5 days in-office in Lakewood, NJ.
Key Responsibilities:
ETL Development and Maintenance: Design, implement, and maintain ETL processes to move and transform data from source systems to data warehouses or data lakes, ensuring data integrity and performance.Data Warehousing: Develop and optimize data warehouse architectures, including the creation of star/snowflake schemas, dimensional models, and maintaining historical data.Database Performance Tuning: Monitor and tune database performance, optimizing SQL queries, indexes, and configurations to ensure maximum performance and minimal downtime.Data Integration: Work with various data sources, including relational databases (SQL Server, PostgreSQL), NoSQL databases, APIs, and flat files, to ensure seamless data integration into the data warehouse or data pipeline.Database Administration: Manage and maintain SQL Server databases, performing tasks such as backup, restore, and disaster recovery planning.Automation: Develop scripts and workflows using Python (or other scripting languages) to automate routine tasks, data pipelines, and monitoring systems.Data Quality and Validation: Implement data quality checks, validation rules, and error handling to ensure data accuracy across systems.Collaboration: Work closely with business stakeholders, data analysts, and other engineers to understand data requirements, troubleshoot issues, and provide technical guidance.Required Skills & Qualifications:
Experience: 3+ years of experience in Data Engineering or a similar role.Technical Expertise:o Strong proficiency with SQL Server, including SSIS (SQL Server Integration Services) and SSRS (SQL Server Reporting Services).
o Advanced SQL query optimization and performance tuning experience.
o Experience with Python for data processing, automation, and scripting tasks.
o Strong understanding of ETL processes, data modeling, and data warehousing techniques.
o Experience with cloud platforms (Azure, AWS, or Google Cloud) and cloud-based data warehousing (e.g., Snowflake, Redshift, BigQuery) is a plus.
Tools & Technologies:o Experience with version control systems (Git, GitHub, etc.).
o Familiarity with job scheduling tools (Airflow, Apache NiFi, etc.).
o Familiarity with BI tools like Power BI or Tableau is a plus.
Problem-Solving: Strong analytical and problem-solving skills, particularly with data issues and performance bottlenecks.Communication: Excellent verbal and written communication skills, with the ability to explain complex data processes to both technical and non-technical stakeholders.
Job-2634051
*LI-MG1