Crimson Phoenix
Data Engineer
Crimson Phoenix, Mc Lean, Virginia, us, 22107
What You Will Be Doing :
Developing new tools, code, and services to execute data engineering activities.Movement of structure and unstructured data using approved methods.Executing data ingestion activities for storing data in a local or enterprise level location.Viewing data in its source format.Developing code to format data that supports exploration.Analyzing source data formats and working with Data Scientists and partners to determine the formats and transforms that best meet mission objectives.Developing code and tools to provide one-time and on-going data formatting and transformations into enterprise or boutique data models.Implementing existing ETL code and best practices/standards.Developing an ETL Code Transition Plan.Developing and delivering documentation for each project including ETL mappings, code use guide, code location, and access instructions.Facilitating Code Reviews.Providing consulting services to support data transport, ingestion, conditioning, access, and management.Required Skills:
Must Have :
MUST HAVE a Current and Active Top Secret SCI with Polygraph, as the customer is NOT sponsoring clearances.Experience with Extract, Transform, and Load (ETL) tools and processes.Python.AWS.SQL.APIs.Linux.Geospatial tools/data.Desired Skills:
Nice to Have :
Docker.Jenkins.Hadoop/Spark.Kibana.Kafka.NiFi.ElasticSearch.
Developing new tools, code, and services to execute data engineering activities.Movement of structure and unstructured data using approved methods.Executing data ingestion activities for storing data in a local or enterprise level location.Viewing data in its source format.Developing code to format data that supports exploration.Analyzing source data formats and working with Data Scientists and partners to determine the formats and transforms that best meet mission objectives.Developing code and tools to provide one-time and on-going data formatting and transformations into enterprise or boutique data models.Implementing existing ETL code and best practices/standards.Developing an ETL Code Transition Plan.Developing and delivering documentation for each project including ETL mappings, code use guide, code location, and access instructions.Facilitating Code Reviews.Providing consulting services to support data transport, ingestion, conditioning, access, and management.Required Skills:
Must Have :
MUST HAVE a Current and Active Top Secret SCI with Polygraph, as the customer is NOT sponsoring clearances.Experience with Extract, Transform, and Load (ETL) tools and processes.Python.AWS.SQL.APIs.Linux.Geospatial tools/data.Desired Skills:
Nice to Have :
Docker.Jenkins.Hadoop/Spark.Kibana.Kafka.NiFi.ElasticSearch.