Data Engineer (Databricks)

Have you ever envisioned a world where data seamlessly transforms into insights, propelling businesses forward? Imagine being at the forefront of this data-driven revolution, crafting sophisticated data pipelines and harnessing the power of visualizations. Join us, where your passion for data engineering meets limitless possibilities!

About Sharesource:

We are a social enterprise dedicated to connecting global opportunities with talented individuals. Currently, we serve Australian clients and aim to empower businesses to thrive by accessing the talent they need worldwide. Our mission is to support individuals in achieving success in their careers while fostering a company culture that embodies our values.

What are we looking for?We are in search of a dynamic Data Engineer, passionate about leveraging technology to deliver exceptional value to customers. As a crucial part of our team, you'll be responsible for designing and implementing data pipelines, ensuring high-quality data integration, and contributing to innovative solutions.

What are you expected to do?

Design and implement data pipelines for extracting and loading data into a central data store

Collaborate with stakeholders to understand business requirements and design data models

Optimise and enhance existing data pipelines for high performance and reliability

Develop and maintain data quality checks to ensure accuracy and completeness

Monitor and maintain data pipelines, identifying areas for improvement

Participate in code reviews and collaborate with other engineers to maintain high-quality code

Create visualisations using tools like Power BI

Stay updated with industry trends, recommending new tools and technologies for data infrastructure improvement

Participate in discovery workshops and solutions design activities with customers

You’ll be a great fit if:

You have at least 5 years of related experience

You have strong experience with Databricks, Snowflake, Redshift, or Synapse

You demonstrate proficiency in AWS and/or Azure

You possess extensive knowledge of ETL processes and data integration

You showcase expertise in data warehousing, modelling, and lake house architecture

You possess strong programming skills in Python, SQL, and Spark

You excel in communication and collaboration

You have hands-on experience with Python (Pyspark, Lambda, Batch, Glue, DataFlow, etc)

You work with customers to elicit requirements and scope projects

You demonstrate proficiency in data transformation and migration

You understand Data Governance concepts (MDM, Metadata management, Data Security, Data Quality, etc)

You continuously monitor and maintain data pipelines, ensuring they run smoothly and identifying areas for improvement

We will be absolutely thrilled if you also have the following:

You possess visualization skills with an eye for aesthetics

You demonstrate descriptive Data Analytics skills with PowerBI

You have experience in Data Lake establishment and/or data pipeline development

Your dashboard proficiency includes Tableau, Kibana, Quicksight, PowerBI

You are familiar with commercial ETL tools like DBT, Talend, Informatica, or Attunity

You have exposure to Infrastructure as code and cloud deployment

You are familiar with Bitbucket, GitHub, Azure DevOps

Here are the benefits of joining our team:

Competitive salary and professional development

Collaborative client partnerships and a fun, inclusive work environment

Opportunities for leadership, expertise, and global client exposure

Monthly coaching, training, and career development

Remote work flexibility and a flexible hybrid model

Engage in social impact activities and industry impact

Achieve work-life balance and flexibility to support personal commitments

Comprehensive HMO coverage with one free dependent

What happens after you submit your application?

The whole process takes around 4 weeks:

There will be 3-4 interviews and a possible assessment from our client partner. You will undergo an initial interview, a culture interview, and 1-2 interviews with our client.

We will constantly communicate with you as to the development of your application. You can also directly communicate with us to ask about the status of your application.

If all goes well, we complete the reference check and provide other necessary requirements so we can offer you the job right away.

At Sharesource, we believe in the value of diversity and inclusion. We are committed to creating a diverse, respectful, and inclusive workplace, and we do not discriminate based on factors such as race, gender, religion, sexual orientation, or disability.

#J-18808-Ljbffr