Splunk Infrastructure Engineer

Job Title: Sr. Splunk Infrastructure Engineer Location: Owings Mills, MD (Hybrid) GC or USC Job Description: Sr. Splunk Infrastructure Engineering The candidate selected for this role will be part of the Reliability and Integrations Engineering team within the Technology Services Engineering group. The Reliability Ops team supports observability and developer productivity platforms at the client. The Sr. Splunk Infrastructure Engineer will be responsible for supporting Splunk Enterprise, including managing Windows and Linux servers, automating through Ansible, and coordinating the migration of on-premises hardware to AWS. Support onboarding and maintenance of logs to Splunk from windows, Linux and cloud-based sources Support platform upgrades including coordinating testing of upgrades with users of the platform Automating manual platform management processes through Ansible or other scripting tools/languages Troubleshooting incidents impacting the Splunk platform Evaluate the use and integration of third-party add-ons Coordinating and collaboration with users of the platform Develop training and documentation materials Qualifications: Ability to troubleshoot and diagnose complex issues Able to demonstrate experience supporting technical users and conduct requirements analysis Can work independently with minimal guidance & oversight Experience with IT Service Management and familiarity with Incident & Problem management Highly skilled in identifying performance bottlenecks, identifying anomalous system behavior, and resolving root cause of service issues. Demonstrated ability to effectively work across teams and functions to influence design, operations, and deployment of highly available software Knowledge of standard methodologies related to security, performance, and disaster recovery Required Technical Expertise 3 years experience managing and configuring Splunk Enterprise and/or Splunk Cloud Experience with Splunk clustered deployment topology Experience with Linux and Windows agents for Splunk administration Experience in designing, developing, and deploying cloud-based solutions using AWS Experience in onboarding new data, configuration, creating new dashboards, extracting information through Splunk Experience with writing or modifying custom Splunk addons Demonstrated proficiency with scripting and automation (bash, python, other programming languages) Familiarity with Splunk rest APIs Preferred Technical Experience Splunk Certification (Admin or Architect) Experience with Ansible tower automations Experience using Gitlab Experience with large platform migration efforts Experience with AWS OpenSearch Experience with Cribl