Dev Technology
Senior Data Engineer
Dev Technology, Ashburn, Virginia, United States, 22011
Senior Data Engineer #787
Clearance: Active DHS Public Trust or similar clearance that will gain reciprocity
What You'll Be Doing
The Senior Data Engineer will work with our data warehousing team to transform transactional data into datasets that are consumable by a variety of consumers, for reporting and analytics. The successful candidate will be flexible and forward-leaning, able to learn new tools and skills, and able to learn new data domain
s as the data warehouse grows.
Required Skills and Experience:
Bachelor’s degree plus at least 7 years in a data engineering role including ETL development, database development, data integration, data mining, big data
Strong experience developing and maintaining complex SQL for ETL and reporting
Strong experience with large complex data systems
Experience performing database administration tasks (manage scheduled jobs, cluster configurations)
Experience performing software administration tasks (deploy applications, manage scheduled tasks)
Ability to learn new tools quickly as needed to provide new ideas for solving problems
Ability and desire to work with other program staff and customers to reach design decisions within given constraints
Excellent diplomacy and communication skills with both clients and technical staff
Preferred Skills and Experience:
Proficiency in Python and Scala
Experience using Spark and Hive
Experience with Qlik or other data visualization administration
Experience completing Databricks development and/or administrative tasks
Familiarity with some of these tools: DB2, Oracle, SAP, Postgres, Elastic Search, Glacier, Cassandra, DynamoDB, Hadoop, Splunk, SAP HANA, Databricks
Experience working with federal government clients
#J-18808-Ljbffr
Clearance: Active DHS Public Trust or similar clearance that will gain reciprocity
What You'll Be Doing
The Senior Data Engineer will work with our data warehousing team to transform transactional data into datasets that are consumable by a variety of consumers, for reporting and analytics. The successful candidate will be flexible and forward-leaning, able to learn new tools and skills, and able to learn new data domain
s as the data warehouse grows.
Required Skills and Experience:
Bachelor’s degree plus at least 7 years in a data engineering role including ETL development, database development, data integration, data mining, big data
Strong experience developing and maintaining complex SQL for ETL and reporting
Strong experience with large complex data systems
Experience performing database administration tasks (manage scheduled jobs, cluster configurations)
Experience performing software administration tasks (deploy applications, manage scheduled tasks)
Ability to learn new tools quickly as needed to provide new ideas for solving problems
Ability and desire to work with other program staff and customers to reach design decisions within given constraints
Excellent diplomacy and communication skills with both clients and technical staff
Preferred Skills and Experience:
Proficiency in Python and Scala
Experience using Spark and Hive
Experience with Qlik or other data visualization administration
Experience completing Databricks development and/or administrative tasks
Familiarity with some of these tools: DB2, Oracle, SAP, Postgres, Elastic Search, Glacier, Cassandra, DynamoDB, Hadoop, Splunk, SAP HANA, Databricks
Experience working with federal government clients
#J-18808-Ljbffr