Logo
Brillio

Lead Data Engineer

Brillio, San Jose, California, United States, 95199


About Brillio:

Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital adoption. Brillio, renowned for its world-class professionals, referred to as "Brillians", distinguishes itself through their capacity to seamlessly integrate cutting-edge digital and design thinking skills with an unwavering dedication to client satisfaction.

Brillio takes pride in its status as an employer of choice, consistently attracting the most exceptional and talented individuals due to its unwavering emphasis on contemporary, groundbreaking technologies, and exclusive digital projects. Brillio's relentless commitment to providing an exceptional experience to its Brillians and nurturing their full potential consistently garners them the Great Place to Work® certification year after year.

Lead Data Engineer

Primary SkillsETL Fundamentals, HDFS, Hive, MapReduce, Modern Data Platform Fundamentals, Oozie, PLSQL, Python, Spark - Pyspark, Spark - Scala, SQLSecondary Skills

JavaSpecialization

Big Data Engineering: Associate BI EngineerJob requirements

Previous experience as a data engineer or in a similar role Strong and hands-on Knowledge of programming languages (e.g. Java and Python).Experience with popular Python frameworks such as Django, Flask or Pyramid.In-depth understanding of the Python software development stacks, ecosystems, frameworks and tools such as Numpy, Scipy, Pandas, Dask, spaCy, NLTK, sci-kit-learn and PyTorch.Experience with popular Python frameworks pysaprk,databricks,flink nosql db could be added advantages.

Preferred skills and qualificationsTechnical expertise with data models, data mining, and segmentation techniques.Hands-on experience with SQL database design Great numerical and analytical skills Data engineering certification.Familiarity with database technologies such as SQL and NoSQL.Excellent problem-solving ability with solid communication and collaboration skills.Knowledge of data science and machine learning concepts and tools.A working understanding of cloud platforms such as AWS, Google Cloud or Azure.Contributions to open-source Python projects or active involvement in the Python community.#LI-PA1Equal Employment Opportunity Declaration

Brillio is an equal opportunity employer to all, regardless of age, ancestry, colour, disability (mental and physical), exercising the right to family care and medical leave, gender, gender expression, gender identity, genetic information, marital status, medical condition, military or veteran status, national origin, political affiliation, race, religious creed, sex (includes pregnancy, childbirth, breastfeeding, and related medical conditions), and sexual orientation.

$120,000 - $140,000 a year

Know what it's like to work and grow at Brillio: Click here