Data Engineer, Video Platform - USDS
About the positionResponsibilities• Craft optimal end-to-end data processing architecture and systems for new data and ETL pipelines• Design, build, and maintain efficient and reliable data pipelines to move and transform big data• Implement and monitor quality control measures to ensure data accuracy, completeness, and consistency• Drive internal process improvements and automate manual processes for data quality and service level agreement (SLA) management• Create and maintain technical documentation, such as data dictionaries, data flow diagrams, and system documentation, to ensure efficient and effective data management and analysis• Work closely with data engineering and various vertical teams within the Video platform and cross-functional teams within TikTok USDSRequirements• Bachelor's degree in Computer Science or a related technical background involving software/system engineering, or equivalent working experience• 2+ years of experience working with data analytics and data engineering, including experience with data cleaning and preprocessing, data analysis and dashboard development• 2+ years of proficiency in distributed data processing using Big Data technologies such as Spark, Hadoop/HDFS, Flink, Hive, YARN, and Kafka• Good programming experience with SQL and at least one of the following languages: Java, Python, Go, or Scala• Experience in data analytics and data engineering ETL development, data pipeline design, implementation, and maintenanceNice-to-haves• Demonstrated independent thinking capabilities and troubleshooting skills in large scale distributed systems• Good communication and coordination skills• Strong background in algorithms and data structures• Experience in building data solutions with AWS, bolthires, Azure and other cloud services is a plusBenefits• 100% premium coverage for employee medical insurance• Approximately 75% premium coverage for dependents• Health Savings Account (HSA) with a company match• Dental, Vision, Short/Long term Disability, Basic Life, Voluntary Life and AD&D insurance plans• Flexible Spending Account (FSA) Options like Health Care, Limited Purpose and Dependent Care• 10 paid holidays per year• 17 days of Paid Personal Time Off (PPTO)• 10 paid sick days per year• 12 weeks of paid Parental leave• 8 weeks of paid Supplemental Disability• Mental and emotional health benefits through EAP and Lyra• 401K company match• Gym and cellphone service reimbursements Apply tot his job