Cloudera CDP Public Cloud Administrator - System One

CLOUDERA CDP PUBLIC CLOUD ADMINISTRATOR – Hybrid, Reston VA

12 Month+ Contract to Hire

ALTA IT Services is seeking a Cloudera CDP PUBLIC CLOUD Big Data Administrator (NOT a Developer) to support a Reston, VA-based health insurance customer. This is a hybrid position. Contract to Hire

RESPONSIBILITIES

• Experience with building Cloudera clusters, setting up NiFi, SOLR, HBase, Kafka, and Knox in the Cloud using

  CDP Public Cloud v7.2.17 or higher.

  Set up High Availability of Services like Hue, Hive, HBase REST, SOLR, and IMPALA on top of the all-new clusters that were built on the BDPaaS Platform.
• Write shell scripts to monitor the health check of services and respond accordingly to any warning or failure conditions.
• Monitor the health of all the services running in the production cluster using the Cloudera Manager.
• Perform/access databases, metastore tables, and write Hive, and Impala queries using HUE.
• Monitor the health of the Services on top of all clusters.
• Work closely with the Application Development team, Security team, and Platform Support to identify and implement the Configurational changes that are needed on top of the cluster for better performance of the services.

REQUIRED SKILLS

• Cloudera CDP Public Cloud v7.2.17 or higher
• Apache Kafka - strong administration & troubleshooting skills
• Kafka Streams - API stream processing with KStreams & Ktables
• Kafka integration with IBM MQ
• Kafka broker management
• Topic/ offset management
• Apache Nifi – Administration
• Flow management, registry server management, controller service management
• NiFi to Kafka /HBase /SOLR integration
• HBase – administration, database management and troubleshooting
• SOLR – administration, manage Logging level, manage shards & high availability
• Collection management
• Rectify resource intensive & long-running SOLR queries

ADDITIONAL MUST HAVE SKILLS:

• Proficient with handling AWS EC2, S3, EBS, EFS
• Ensure Cloudera installation and configuration meet optimal specifications (CDP, CDSW, Hive, Spark, NiFi).
• Design and implement big data pipelines and automated data flows using Python/R and NiFi.
• Assist and provide expertise as it pertains to automating the entire project lifecycle.
• Perform incremental updates and upgrades to the Cloudera environment with newer versions.
• Assist with new use cases (i.e., analytics/ML, data science, data ingest and processing)
• Infrastructure (including new cluster deployments, cluster migration, expansion, major upgrades, COOP/DR, and security).
• Assist in testing, governance, data quality, training, and documentation efforts.
• Move data and use YARN to allocate resources and schedule jobs.
• Manage job workflows with Hue.
• Implement comprehensive security policies across the Hadoop cluster using Ranger.
• Troubleshoot potential issues with Kerberos, TLS/SSL, Models, and Experiments, as well as other workload issues that data scientists might encounter once the application is running.
• Support Big Data / Hadoop databases throughout the development and production lifecycle.
• Troubleshoot and resolve database integrity issues, performance issues, blocking and deadlocking issues, replication issues, log shipping issues, connectivity issues, security issues, performance tuning, query optimization, using monitoring and troubleshooting tools.
• Create, test, and implement scripting for automation support.
• Experience with the Kafka ecosystem (Kafka Brokers, Connect, Zookeeper) in production is ideal.
• Implement and support streaming technologies such as Kafka, Spark & Kudu.

HOURLY RATE: $65/HR. Benefits Available. C2C is OK

For consideration, please send an updated resume to Melissa McNally via mmcnally@altaits.com

System One, and its subsidiaries are leaders in delivering outsourced services and workforce solutions across North America. We help clients get work done more efficiently and economically, without compromising quality. System One not only serves as a valued partner for our clients, but we offer eligible employees health and welfare benefits coverage options including medical, dental, vision, spending accounts, life insurance, voluntary plans, as well as participation in a 401(k) plan.

System One is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, age, national origin, disability, family care or medical leave status, genetic information, veteran status, marital status, or any other characteristic protected by applicable federal, state, or local law.