Solution Architect - Raritan, NJ

10 years of strong experience in building large scale, distributed big data solutions Proven track record of consistently architecting, designing, developing and/or implementing an end-to-end Big Data Lake, Business Intelligence - Tableau/Power BI/Qlik, Data Science project. Solid experience in building Big Data Pipelines (Batch and NRT) on Hadoop Ecosystem including HDFS, Hive, Spark, Scala, Sqoop, Kafka, NiFi, and real time streaming technologies and host of big data open source stack. Well versed with performance tuning of compute heavy workloads. Working experience in Cloudera distribution and AWS/Azure/GCP Cloud. Solid understanding of Data Quality, Data Governance and Data Security. Experience in big data solutions like Impala, Oozie, Flume, Sqoop or ZooKeeper. Proficient in Python/R, Java, Scala, Ruby or C++. Experience with one of the large cloud-computing infrastructure solutions like AWS Redshift, Snowflake, SQL DW, BigQuery. Good experience in database and hands-on experience in big data technologies such as Hadoop/Hive/Spark/MongoDB, with experience in data ingestion, data wrangling, data virtualization technologies such as StreamSets, Trifacta, Denodo will be a big plus.