[Remote] Lead Palantir Foundry Data Engineer - (Pipeline Builder, Code Repositories, Workshop, Cloud) - 100% Remote

Note:The job is a remote job and is open to candidates in USA. Optomi, in partnership with a leading product manufacturer, is seeking a hands-on Lead Data Engineer for a direct-hire/permanent opportunity. This role is focused on designing, building, and maintaining business applications that leverage Palantir Foundry and modern Big Data technologies within a cloud-based environment. Responsibilities• Establish and maintain best practices in Big Data engineering for a Data Science and Analytics team, with a primary focus on Palantir Foundry pipelines.• Build and optimize data transformation pipelines to curate and report on enterprise-wide datasets (manufacturing, financial, and operational). • Lead a small team of engineers, acting as both hands-on practitioner and technical leader, ensuring successful delivery of advanced data solutions. • Partner with stakeholders to define data strategy, ensuring efficient data management, cloud adoption, and reporting scalability. Skills• Bachelor’s Degree in Computer Science or related field. • 6+ years of strong Data Engineering experience.• Hands-on experience with Palantir Foundry (data integration, transformation, ontology modeling, pipeline orchestration). • Expertise with PySpark and large-scale distributed data processing. • Strong experience with AWS cloud-based Big Data platforms and services (S3, Glue, EMR, Redshift, etc.). • Background in Hadoop-based technologies such as MapReduce, Hive, and Spark. • Proficiency in at least one programming language: Python or Java. • Solid understanding of ETL concepts, with hands-on experience in at least one ETL technology.• Experience with NoSQL (HBase, MongoDB, etc.) and RDBMS (SQL Server, Oracle, MySQL, PostgreSQL). • Familiarity with source control systems (Git) and CI/CD best practices. • Strong analytical and troubleshooting skills, with the ability to interact effectively with business and technical stakeholders. Company Overview• OPTOMI is an IT staffing firm that serves its consultants, clients, and employees through its consultant-focused approach. It was founded in 2012, and is headquartered in Roswell, Georgia, USA, with a workforce of 501-1000 employees.Its website isCompany H1B Sponsorship• Optomi has a track record of offering H1B sponsorships, with 6 in 2025, 6 in 2024, 2 in 2023, 5 in 2022, 8 in 2021, 7 in 2020. Please note that this does not guarantee sponsorship for this specific role. Apply tot his job