Logo
Insight Global

Remote Senior Data Engineer

Insight Global, East Hartford, Connecticut, us, 06118


Insight Global is seeking a Senior Data Engineer to work fully remote, with availability for the east coast time zone. In this role, you will design, construct, install, test, and maintain highly scalable data management systems. You will implement data ingestion routines, both real-time and batch, using best practices in data modeling with Databricks. Optimizing existing pipelines for improved performance, scalability and provide support for deployed data applications and analytical tools.Key responsibilities include:- Developing complex database queries with an emphasis on performance within Databricks environments.- Utilize DBT to manage the transformation layer of the data stack, ensuring efficient ETL processes. -Maintain and extend our library of reusable Python code for various data engineering tasks.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .

To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .

Required Skills & Experience

1. Bachelors or Masters degree in Computer Science, Engineering, Mathematics or related field.2. Minimum 5years of experience in a Data Engineering role with a strong focus on Databricks platform management.3. Proficiency in SQL and experience with relational databases as well as NoSQL databases like Cassandra or MongoDB.4. Extensive experience writing robust ETL jobs using Python programming language; familiarity with Pandas library is preferred.5. Demonstrated ability working with DBT (Data Build Tool) or similar tools for managing datasets transformations in the warehouse layer.6. Experience designing scalable data models to meet end-user reporting needs within Databricks environment is essential.7. Strong understanding of software development best practices including testing automation frameworks.

Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.