Data Engineer

About TikTok U.S. Data Security TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. U.S. Data Security (“USDS”) is a subsidiary of TikTok in the U.S. This new, security-first division was created to bring heightened focus and governance to our data protection policies and content assurance protocols to keep U.S. users safe. Our focus is on providing oversight and protection of the TikTok platform and U.S. user data, so millions of Americans can continue turning to TikTok to learn something new, earn a living, express themselves creatively, or be entertained. The teams within USDS that deliver on this commitment daily span across Trust & Safety, Security & Privacy, Engineering, User & Product Ops, Corporate Functions and more. Why Join Us Creation is the core of TikTok's purpose. Our platform is built to help imaginations thrive. This is doubly true of the teams that make TikTok possible. Together, we inspire creativity and bring joy - a mission we all believe in and aim towards achieving every day. To us, every challenge, no matter how difficult, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At TikTok, we create together and grow together. That's how we drive impact - for ourselves, our company, and the communities we serve. Join us. About the Role: In your role as a Data Engineer, you will play a pivotal part in guiding the strategic direction of US Tech & Prod. This position is intrinsically multifaceted, requiring the candidate to engage with various disciplines. We seek a candidate with a deep passion for data and a knack for swift iterations. Your primary focus will be on improving the speed and quality of data-based decision making by establishing cutting-edge monitoring systems for real-time or near-real-time data collection and analysis. Leveraging statistical analysis, machine learning, and data mining techniques, you will extract meaningful insights from the data, enabling a profound comprehension of user behavior, trends, and patterns. Responsibilities What You'll Need: - The perfect candidate will have strong data infrastructure and data architecture skills, strong operational skills to drive efficiency and speed, strong project management leadership, and a strong vision for how data engineering can proactively improve companies. - Experience working cross-functionally with business stakeholders, engineering, product, and SRE teams to understand business requirements and convert that into technical requirements, including developing prototypes to demonstrate the feasibility of data and analytics solutions. What You'll Do: - Work with business stakeholders, engineering, product and SRE teams to understand business requirements and convert that into technical requirements, including developing prototypes to demonstrate the feasibility of data and analytics solutions. - Extract data from various sources such as APIs, HIVE tables and other structured and unstructured data sources to process and store large volumes of data ensuring data accuracy, consistency, and security. - Design, build, and maintain data pipelines utilizing optimal ETL patterns, frameworks, query techniques, sourcing from structured and unstructured data sources to ensure data is easily accessible and can be used effectively by other members of the organization. - Implement and monitor quality control measures to ensure data accuracy, completeness, and consistency. - Create and maintain technical documentation, such as data dictionaries, data flow diagrams, and system documentation, to ensure efficient and effective data management and analysis.Minimum Qualifications: - Bachelors degree in Statistics, Economics, Computer Science or another quantitative field - 2+ years of experience working with data analytics and data engineering, including experience with data cleaning and preprocessing, data analysis and dashboard development. - 2+ years of proficiency in distributed data processing using Big Data technologies like Spark/Scala, Java, Hadoop/HDFS/AWS/S3, Cassandra and Kafka - Proficiency in data modeling, data design, SQL, and NoSQL databases Preferred Qualifications: - Experience in a consumer web or mobile company - Strong background in algorithms and data structures - Experience working with PII and GDPR data - Ability to communicate effectively, both written and verbal, with technical and non-technical partners - Ability to deliver consistent high quality results while working in a fast paced environment - Passionate, curious, and seeking to tackle every day problems with innovation Candidates for this position must be legally authorized to work in the United States. This position is not eligible for visa sponsorship or support. TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too. TikTok is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at https://shorturl.at/ktJP6. This role requires the ability to work with and support systems designed to protect sensitive data and information. As such, this role will be subject to strict national security-related screening.