Note: The job is a remote job and is open to candidates in USA. Johnson Technology Systems Inc is an IT & Engineering Services provider with extensive experience in delivering professional IT services to the public sector. They are seeking a Microsoft Azure Cloud Engineer/Developer to leverage open source technologies for big data processing, machine learning, and ETL processes.
Responsibilities
- Deep Knowledge on Open Source Technologies for Distributed Data processing, analysis of big data sets including writing jobs to process vast amounts of data and ETL processing, required expertise is over tools such as: Apache Hadoop, MapReduce, Pig, Spark, Databricks, Hive
- Deep Knowledge on Open Source Technologies to perform fast, interactive SQL queries at scale over structured or unstructured big data sets, required expertise is over tools such as: Apache Hive LLAP, Spark SQL, Phoenix
- Deep Knowledge on Open Source Technologies to enable ingestion and processing of millions of streaming events per second: Apache Kafka, Apache Storm, Apache Spark, Apache HBase
- Deep Knowledge on Performance Analysis and Optimization and operation of Apache Hadoop, Spark, Databricks and the others mentioned above
- Deep Knowledge on Open Source Technologies for Machine Learning such as: MLib
- Strong expertise in ETL/ELT approaches and expertise in technologies such as: Azure Data Factory and SQL Server Integration Services
- Software Development skills to write code on Java, Spark Scala, PySpark, Python
Skills
- Deep Knowledge on Open Source Technologies for Distributed Data processing, analysis of big data sets including writing jobs to process vast amounts of data and ETL processing, required expertise is over tools such as: Apache Hadoop, MapReduce, Pig, Spark, Databricks, Hive
- Deep Knowledge on Open Source Technologies to perform fast, interactive SQL queries at scale over structured or unstructured big data sets, required expertise is over tools such as: Apache Hive LLAP, Spark SQL, Phoenix
- Deep Knowledge on Open Source Technologies to enable ingestion and processing of millions of streaming events per second: Apache Kafka, Apache Storm, Apache Spark, Apache HBase
- Deep Knowledge on Performance Analysis and Optimization and operation of Apache Hadoop, Spark, Databricks and the others mentioned above
- Deep Knowledge on Open Source Technologies for Machine Learning such as: MLib
- Strong expertise in ETL/ELT approaches and expertise in technologies such as: Azure Data Factory and SQL Server Integration Services
- Software Development skills to write code on Java, Spark Scala, PySpark, Python
- Design
- Hosted Services Deployment
- IoT Application Management
- MaaS Assessment Services
- Mobile Application Custom Development
- Mobile Application Database Connectivity
- Mobile Application Offline Architecture
- Open Source Container Orchestration
- Relational Database Architecture for Cloud Applications
- Search Design and Architecture
- Serverless Computing
- Unstructured Data Storage Architecture
- Using Xamarin for cross-platform development
- Web Application API Management
- Web Application Development
- Web Application Security
- TO QUALIFY YOU MUST BE US citizens. PRINCIPALS Only. NO Staffing Agencies!!
Company Overview