Note: The job is a remote job and is open to candidates in USA. Inizio Partners is a company seeking a Data Engineer specializing in consent management. The role involves developing and optimizing data pipelines, automating data processes, and ensuring smooth operations between various platforms.
Responsibilities
- Develop, build, optimize and implement pipeline, data ingestion, storage, wrangling, cataloguing, quality, security features from various data sources on cloud
- Monitor and ensure the smooth operation of data pipelines between OneTrust and external Club platforms (ESPs, CRMs, etc.)
- Automate jobs (ingestion & pipelines), notifications and reports
- Assist in the ongoing data integration tasks (e.g., connectors, APIs) between OT and various business systems
- Write quality code and participate in code reviews
- Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD
- Continuously improve systems through performance enhancements and cost reductions in compute and storage
- Prioritize to manage ad-hoc requests in parallel with ongoing sprints
- Participate with the team to execute sound solutions and approaches to meet business expectations in an efficient manner; deliver and execute the technical and product roadmap for data engineering across a variety of technologies
- Experienced with Scrum and Agile Methodologies to coordinate global delivery teams, run scrum ceremonies, manage backlog items, and handle escalations
Skills
- Experience working in AWS, Redshift, Glue and basic API integrations
- Prior exposure to Data Ingestion and Curation work (such as working with Data Lakehouse)
- Knowledge in SQL for purpose of data analysis/investigation
- Work with the Data Product Owners and Data Analysts to help manage and deliver on the product technical roadmap for the data platform
- Degree in computer science, statistics, or related discipline
- 5+ years as a data engineer
- Comfortable making decisions and leading
- Familiar with version control and relational databases
- Familiar with OneTrust or similar consent management platforms
Company Overview