Role: HD Insight Administrator
Location: Pleasanton, CA
• Strong hands-on working experience in Microsoft HD Insights components.
• Experience Troubleshooting issues in Kafka, Spark, Hive, Hbase, Oozie, Zookeeper, YARN, Kerberos, AAD, Ambari usage.
• Hands on experience in analyzing Log files for Hadoop and eco system services and finding root cause.
• Experience in deploying and managing the multi-node development and production Hadoop cluster with different Hadoop components (Hive, Oozie, YARN, Hbase, Zookeeper)
• Experience in scheduling Hadoop/Hive/Sqoop/Hbase jobs using Oozie
• Experience with Groovy, Python & Shell scripting (or PowerShell scripting) is required.
• Design and Develop Platform as a Service (PaaS) Solutions using different Azure Services.
• Must be able to develop solutions on Azure for Cloud Native, Cloud Optimized and Cloud Infrastructure based solutions preferably using Microsoft Technology Stack.
• Design and Develop batch jobs using Jenkins.
• Collaborate with development to improve CI/CD.
• Must have implementation knowledge of using various CI/CD tools on Azure.
• Knowledge of best practices and IT operations in an always-up, always-available service.
• Git & CI/CD tools (Spinnaker, Jenkins, GitHub)
• Experience in Prod support environment.