Square
Senior Data Engineer
Square, San Francisco, California, United States, 94199
Job Description
The Square Banking team is building a suite of new financial products for Square sellers. We offer business checking accounts, savings accounts, credit card, and loans to help our sellers manage their business cash flow. Investing in a Financial Data Mesh Platform is not just about managing data; it’s about unleashing the full potential of our organization’s most valuable asset. It’s a critical strategic move that not only empowers us to use the distinctive value of data but also extends its positive impact to our customers, our Sellers, and users of the Banking platform. As an Engineer focused on Data for Square Banking, you will help us build our own Square Banking Financial Data Mesh Platform, using real-time Big Data technologies and Medallion architecture. You will work directly with product, engineering, data science and machine learning teams to understand their use-case, develop reliable, trusted datasets that accelerate the decision-making process of important products. Qualifications
8+ years as a data engineer or software engineer, with a focus on large-scale data processing and analytics You’ve spent 4+ years as a data engineer building core datasets You are passionate about analytics use cases, data models and solving complex data problems You have hands-on experience shipping scalable data solutions in the cloud (e.g AWS, GCP, Azure), across multiple data stores (e.g Databricks, Snowflake, Redshift, Hive, SQL/NoSQL, columnar storage formats) and methodologies (e.g dimensional modeling, data marts, star/snowflake schemas) You have hands-on experience with highly scalable and reliable data pipelines using BigData (e.g Airflow, DBT, Spark, Hive, Parquet/ORC, Protobuf/Thrift, etc) Optimized and tuned data pipelines to enhance overall system performance, reliability, and scalability Knowledge of programming languages (e.g. Go, Ruby, Java, Python) Willingness to participate in professional development activities to stay current on industry knowledge and passion for trying new things Responsibilities
You will work directly with product, engineering, data science and machine learning teams to understand their use-case, develop reliable, trusted datasets that accelerate the decision-making process of important products You’ll design large-scale, distributed data processing systems and pipelines to ensure efficient and reliable data ingestion, storage, transformation, and analysis Promote high-quality software engineering practices towards building data infrastructure and pipelines at scale You’ll build core datasets to serve as unique sources of truth for product and departments (product, marketing, sales, finance, customer experience, data science, business operations, IT, engineering) You’ll partner with data scientists and other cross-functional partners to understand their needs and build pipelines to scale Identify and address data quality and integrity issues through data validation, cleansing, and data modeling techniques You’ll implement automated workflows that lower manual/operational cost for team members, define and uphold SLAs for timely delivery of data, move us closer to democratizing data and a self-serve model (query exploration, dashboards, data catalog, data discovery) Learn about Big Data architecture via technologies such as AWS, DataBricks and Kafka Stay up to date with emerging technologies, best practices, and industry trends in data engineering and software development Mentor and provide guidance to junior data engineers fostering inclusivity and growth Work remotely with a team of distributed colleagues Report to the Engineering Manager of Banking - Data Engineering
#J-18808-Ljbffr
The Square Banking team is building a suite of new financial products for Square sellers. We offer business checking accounts, savings accounts, credit card, and loans to help our sellers manage their business cash flow. Investing in a Financial Data Mesh Platform is not just about managing data; it’s about unleashing the full potential of our organization’s most valuable asset. It’s a critical strategic move that not only empowers us to use the distinctive value of data but also extends its positive impact to our customers, our Sellers, and users of the Banking platform. As an Engineer focused on Data for Square Banking, you will help us build our own Square Banking Financial Data Mesh Platform, using real-time Big Data technologies and Medallion architecture. You will work directly with product, engineering, data science and machine learning teams to understand their use-case, develop reliable, trusted datasets that accelerate the decision-making process of important products. Qualifications
8+ years as a data engineer or software engineer, with a focus on large-scale data processing and analytics You’ve spent 4+ years as a data engineer building core datasets You are passionate about analytics use cases, data models and solving complex data problems You have hands-on experience shipping scalable data solutions in the cloud (e.g AWS, GCP, Azure), across multiple data stores (e.g Databricks, Snowflake, Redshift, Hive, SQL/NoSQL, columnar storage formats) and methodologies (e.g dimensional modeling, data marts, star/snowflake schemas) You have hands-on experience with highly scalable and reliable data pipelines using BigData (e.g Airflow, DBT, Spark, Hive, Parquet/ORC, Protobuf/Thrift, etc) Optimized and tuned data pipelines to enhance overall system performance, reliability, and scalability Knowledge of programming languages (e.g. Go, Ruby, Java, Python) Willingness to participate in professional development activities to stay current on industry knowledge and passion for trying new things Responsibilities
You will work directly with product, engineering, data science and machine learning teams to understand their use-case, develop reliable, trusted datasets that accelerate the decision-making process of important products You’ll design large-scale, distributed data processing systems and pipelines to ensure efficient and reliable data ingestion, storage, transformation, and analysis Promote high-quality software engineering practices towards building data infrastructure and pipelines at scale You’ll build core datasets to serve as unique sources of truth for product and departments (product, marketing, sales, finance, customer experience, data science, business operations, IT, engineering) You’ll partner with data scientists and other cross-functional partners to understand their needs and build pipelines to scale Identify and address data quality and integrity issues through data validation, cleansing, and data modeling techniques You’ll implement automated workflows that lower manual/operational cost for team members, define and uphold SLAs for timely delivery of data, move us closer to democratizing data and a self-serve model (query exploration, dashboards, data catalog, data discovery) Learn about Big Data architecture via technologies such as AWS, DataBricks and Kafka Stay up to date with emerging technologies, best practices, and industry trends in data engineering and software development Mentor and provide guidance to junior data engineers fostering inclusivity and growth Work remotely with a team of distributed colleagues Report to the Engineering Manager of Banking - Data Engineering
#J-18808-Ljbffr