Manager, Hadoop Administrator
KPMG - Dallas, TX
Employment Type : Full-Time
Known for being a great place to work and build a career, KPMG provides audit, tax and advisory services for organizations in today’s most important industries. Our growth is driven by delivering real results for our clients. It’s also enabled by our culture, which encourages individual development, embraces an inclusive environment, rewards innovative excellence and supports our communities. With qualities like those, it’s no wonder we’re consistently ranked among the best companies to work for by Fortune Magazine, Consulting Magazine, Working Mother Magazine, Diversity Inc. and others. If you’re as passionate about your future as we are, join our team.
KPMG is currently seeking a Manager, Hadoop Administrator to join our Digital Nexus technology organization.
Responsibilities:
- Accountable for building, configuring, administering and deploying data and tool capabilities on Cloud and on prem to support data strategy initiatives; apply deep knowledge of Azure and Hortonworks big data and analytics components to administer and configure environments
- Install, configure, optimize, and administer custom components and data management tools; continually evaluate workloads; responsible for working closely with development teams and provide capacity planning and estimating; work with data engineering related groups in the support of deployment of jobs
- Responsible for resource and security management on Azure big data components; code/decode advanced algorithms and trouble shoot to build high-performance, parallel, and distributed solutions and ensure the design, code, and procedural aspects of solution are production ready, in terms of operational, security and compliance standards
- Work with various cross functional teams such as infrastructure, data and enterprise architects to tune, integrate, optimize the platform to meet functional and technical requirements
- Design, implement, and enforce security policies and user access and provisioning requirements; work closely with workstreams and projects to propose, create, maintain platform runbooks, and improve automation, as well as with various stakeholders and teams to create, maintain technical architecture and design documents
- Handle and identify possible failure scenarios, respond to end users of Hadoop platform on data or application issues, report and monitor daily SLA that identifies vulnerabilities and opportunities for improvement; monitor connectivity, performance, and security alerts, manage and review log files; troubleshoot errors across the environments
Qualifications:
- Minimum of five years of experience as a Hadoop Administrator
- Bachelor’s degree from an accredited college/university; professional training and certifications in various big data solutions is preferred
- Experience in Data Platforms, Hadoop platform implementation and administration skills, Azure Big data Services, designing and implementing end to end Azure cloud big data solutions, setting up and administering Data Management Tools like Zaloni, Databricks, and HDInsight, running data pipelines at scale in production, implementation Azure big data Platform, CI/CD tools (Jenkins, Ansible) ideally infra-as-code via Terraform, designing, implementing and successfully operationalizing large-scale data lakes solutions in production environments, implementing Real-time Solutions & data integrations and Shell or Linux scripting required. Hortonworks (HDFS, Hbase, Spark, Nifi, Spark), Kerberos; as well as Kerberos for security, Ranger, Kafka, HDFS, Hive
- Hands on experience with building, optimizing the data pipe – CI/CD, integrated - build and deployment automation, configuration management, test automation solutions as well as with Hadoop, HIVE, HBase, Spark, Kafka, Python, SQL, Spark RDDs and Data Frames, Ambari, Ranger, Kerberos, Atlas
- Solid understanding of Azure Cloud Stack including ADF Data flows, Event Hub, Databricks, HDInsight, Azure DevOps, as well as understanding of, and proven experience with, performance tuning, scalability, and security in Hortonworks/Cloudera and Microsoft Azure environments
- Strong verbal/written communication with ability to effectively interact with individuals at all levels of responsibility and authority; must be able to prioritize, delegate and foster the development of high-performance teams to lead/support an environment driven by customer service and teamwork; Strong trouble-shooting and organizational skills and ability to work on multiple projects simultaneously; ability to participate in resource planning processes based on defined organizational plans; experience working with geographically distributed teams
KPMG LLP (the U.S. member firm of KPMG International) offers a comprehensive compensation and benefits package. KPMG is an affirmative action-equal opportunity employer. KPMG complies with all applicable federal, state and local laws regarding recruitment and hiring. All qualified applicants are considered for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, protected veteran status, or any other category protected by applicable federal, state or local laws. The attached link contains further information regarding the firm's compliance with federal, state and local recruitment and hiring laws. No phone calls or agencies please.