Machine Learning Engineer, Multimodality

DescriptionTikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and its offices include New York, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo. Why Join UsCreation is the core of TikTok's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At TikTok, we create together and grow together. That's how we drive impact-for ourselves, our company, and the users we serve. Join us.Our Business Integrity team has a strong user focus and a dedication to technical excellence. We aim to meet our users’ needs with reliable and high-performing platforms and services.We use an AIGC large model, deep learning, machine learning and other technologies to establish a safe and trusted connection between billions of active users and the company's commercial products (advertising, e-commerce, live broadcast, etc.). By building a highly concurrent and highly reliable risk control system, we can perceive and deal with the risks of commercial products in real time. By building an end-to-end deep learning model and machine learning system, we can understand the content of commercial products and automatically review tens of millions of content in a short time. We sincerely invite you to join us and build the most advanced risk control system in the industry.Responsibilities:1. Responsible for understanding content of advertisements, including titles, images, videos, OCR texts, ASR texts, etc.2. Responsible for the construction of models, such as AIGC model, image/video model, multimodality model, etc.3. Responsible for model acceleration, improving inference efficiency while maintaining the effectiveness of models.4. Responsible for tracking and implementation of SOTA technologies in the CV/Multimodality.QualificationsMinimum Qualifications1. Excellent algorithm foundation and programming ability, familiar with mainstream programming languages such as python/c++.2. Familiar with model training frameworks, such as tensorflow, pytorch, mxnet, etc.3. Proficiency in building or finetuning LLMs at scale. Worked across CV, NLP or text/audio technologies. Preferred Qualifications1. Excellent algorithm foundation and programming ability, familiar with mainstream programming languages such as python/c++.2. Familiar with NLP-related tasks, such as text classification, keyword matching, large language model (LLM), etc.3. Familiar with CV-related tasks, such as image/video classification, object detection, retrieval, etc.4. Familiar with multimodality technologies, such as vision-language pretraining.5. Bachelor's degree or above, majoring in Computer Science, Computer Engineering, Electrical Engineering, or other related fields.6. Have excellent analytical and problem-solving skills, logical thinking skills, communication and collaboration skills. Maintain curiosity about new things, and have a strong sense of responsibility, integrity and reliability.7. Experience in Gen-AI or AIGC models is preferred.8. Published papers in CVPR, ICCV, ECCV, TPAMI, IJCV, ICML, NeurIPS, ICLR, ACL, EMNLP, NAACL, etc. TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.TikTok is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at https://shorturl.at/cdpT2RegularExperienced