Logo
Insight Global

Insight Global is hiring: Remote Senior Data Engineer in East Hartford

Insight Global, East Hartford, CT, United States


Job Description Insight Global is seeking a Senior Data Engineer to work fully remote, with availability for the east coast time zone. In this role, you will design, construct, install, test, and maintain highly scalable data management systems. You will implement data ingestion routines, both real-time and batch, using best practices in data modeling with Databricks. Optimizing existing pipelines for improved performance, scalability and provide support for deployed data applications and analytical tools. Key responsibilities include: -Developing complex database queries with an emphasis on performance within Databricks environments. -Utilize DBT to manage the transformation layer of the data stack, ensuring efficient ETL processes. -Maintain and extend our library of reusable Python code for various data engineering tasks. We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com . To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ . Skills and Requirements 1. Bachelors or Masters degree in Computer Science, Engineering, Mathematics or related field. 2. Minimum 5years of experience in a Data Engineering role with a strong focus on Databricks platform management. 3. Proficiency in SQL and experience with relational databases as well as NoSQL databases like Cassandra or MongoDB. 4. Extensive experience writing robust ETL jobs using Python programming language; familiarity with Pandas library is preferred. 5. Demonstrated ability working with DBT (Data Build Tool) or similar tools for managing datasets transformations in the warehouse layer. 6. Experience designing scalable data models to meet end-user reporting needs within Databricks environment is essential. 7. Strong understanding of software development best practices including testing automation frameworks. null We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.