Omni Inclusive
Sr. Data Engineer
Omni Inclusive, El Segundo, California, United States, 90245
Mandatory skills -
GBQ (Google BigQuery), ETL, Python
Experience in Google Cloud Platform (GBQ, GCS, Kubernetes POD operator and Image creation, Composer, DAG creation)Python Programming ExpertExperience in Ascend toolCreate Data flow, Data service, Read and Write connection for the various sources.Failure Notification settings (Ascend Webhook notification, Scheduling in Ascend)Big query merge to perform mergeCustom Read and Write connector using python frameworkGood understanding in Error loggingExperience in Airflow (Create DAG, Configure the variables in Airflow, Scheduling)Experience in DBT to create the lineage in GCP. - OptionalWorked in Dev-Sec-Ops (CI/CD) environment.Experienced with containerized execution/code containerizationInteract with the platform leads and 3rd party application leads to understand and analyze the various interfaces and data integration needs to create technical user storiesContribute to the creation of technical design, estimation as applicable for the user stories and review with the EAC team and Product OwnerConduct and participate in code review sessions for the team deliverablesGuides the team members and involves in development and unit testingWork with business users for UAT and assist QA team accordingly for defects fixingHelp the team to troubleshoot critical issues in development, staging or prodRetail & Manufacturing Domain expertise.
GBQ (Google BigQuery), ETL, Python
Experience in Google Cloud Platform (GBQ, GCS, Kubernetes POD operator and Image creation, Composer, DAG creation)Python Programming ExpertExperience in Ascend toolCreate Data flow, Data service, Read and Write connection for the various sources.Failure Notification settings (Ascend Webhook notification, Scheduling in Ascend)Big query merge to perform mergeCustom Read and Write connector using python frameworkGood understanding in Error loggingExperience in Airflow (Create DAG, Configure the variables in Airflow, Scheduling)Experience in DBT to create the lineage in GCP. - OptionalWorked in Dev-Sec-Ops (CI/CD) environment.Experienced with containerized execution/code containerizationInteract with the platform leads and 3rd party application leads to understand and analyze the various interfaces and data integration needs to create technical user storiesContribute to the creation of technical design, estimation as applicable for the user stories and review with the EAC team and Product OwnerConduct and participate in code review sessions for the team deliverablesGuides the team members and involves in development and unit testingWork with business users for UAT and assist QA team accordingly for defects fixingHelp the team to troubleshoot critical issues in development, staging or prodRetail & Manufacturing Domain expertise.