Lorven Technologies
Big Data Engineer - 12+ months contract - Phoenix, AZ
Lorven Technologies, Phoenix, Arizona, United States, 85003
Job Title: Big Data Engineer
Job Location: Phoenix, AZ (Onsite)
Duration: 12+ months contract
Must Have Big Data ETL-Big Data/Data Warehousing Data Analytics PySpark Hive Unix Scripting. Description:
Hands-on expertise with application design, software development and automated testing # Experience with distributed (multi-tiered) systems, algorithms, and relational databases Bachelor Degree in computer science, computer science engineering, or related experience required; advanced degree preferred Hands-on expertise with application design and software development in Big Data across one or more platforms, languages, and tools. (Hadoop/ Spark/ HIVE/ NoSQL & SQL Databases). Have had prior experience of architecting data abstraction layers using some NoSQL/in-memory database Data modeling and data architecture experience will be an advantage Expert on Dimensional modelling concepts. Strong knowledge on Oracle SQL, ETL performance tuning and unix scripting. Ability to effectively collaborate with Finance SMEs and partners of all levels to understand their business processes and take overall ownership of Analysis, Design, Estimation and Delivery of technical solutions for Finance business requirements and roadmaps. Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases (Mysql, Oracle, Yellow brick). Expertise in Big Data querying tools, such as Pig, Hive, Spark and Impala. Solid understanding of data structures, Algorithms & Design Patterns and Strong programming knowledge in Java. Experience in analytical languages (Python or the equivalent) and knowledge about machine learning techniques. Also analyzing and building dashboards with data visualization tools such as Tableau using accelerator database Jethro. Extensive experiencing in application, integration, system and regression testing, including demonstration of automation and other CI/CD efforts. Experience with version control software like git and CI/CD testing/automation experience.
Job Location: Phoenix, AZ (Onsite)
Duration: 12+ months contract
Must Have Big Data ETL-Big Data/Data Warehousing Data Analytics PySpark Hive Unix Scripting. Description:
Hands-on expertise with application design, software development and automated testing # Experience with distributed (multi-tiered) systems, algorithms, and relational databases Bachelor Degree in computer science, computer science engineering, or related experience required; advanced degree preferred Hands-on expertise with application design and software development in Big Data across one or more platforms, languages, and tools. (Hadoop/ Spark/ HIVE/ NoSQL & SQL Databases). Have had prior experience of architecting data abstraction layers using some NoSQL/in-memory database Data modeling and data architecture experience will be an advantage Expert on Dimensional modelling concepts. Strong knowledge on Oracle SQL, ETL performance tuning and unix scripting. Ability to effectively collaborate with Finance SMEs and partners of all levels to understand their business processes and take overall ownership of Analysis, Design, Estimation and Delivery of technical solutions for Finance business requirements and roadmaps. Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases (Mysql, Oracle, Yellow brick). Expertise in Big Data querying tools, such as Pig, Hive, Spark and Impala. Solid understanding of data structures, Algorithms & Design Patterns and Strong programming knowledge in Java. Experience in analytical languages (Python or the equivalent) and knowledge about machine learning techniques. Also analyzing and building dashboards with data visualization tools such as Tableau using accelerator database Jethro. Extensive experiencing in application, integration, system and regression testing, including demonstration of automation and other CI/CD efforts. Experience with version control software like git and CI/CD testing/automation experience.